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Set Books 


D. L. Kreider, R. G. Kuller, D. R. Ostberg and F. W. Perkins, An Intro- 
duction to Linear Analysis (Addison-Wesley, 1966). 
E. D. Nering, Linear Algebra and Matrix Theory (John Wiley, 1970). 


Tt is essential to have these books; the course is based on them and will not 
make sense without them. 


Conventions 


Before working through this correspondence text make sure you have 
read A Guide to the Linear Mathematics Course. Of the typographical 
conventions given in the Guide the following are the most important. 


The set books are referred to as: 


K for An Introduction to Linear Analysis 
N for Linear Algebra and Matrix Theory 


All starred items in the summaries are examinable. 


References to the Open University Mathematics Foundation Course Units 
(The Open University Press, 1971) take the form Unit M100 3, Operations 
and Morphisms. 


1.0 INTRODUCTION 


This first unit sets the stage for the remainder of the course. In a sense, it 
is a review of the basic ideas connected with a vector space which were 
included or hinted at in the Foundation Course, M100, in particular in 
Units M100 22 and M100 23, Linear Algebra I and II. However, there is an 
important difference here in that we are now going to be more precise in 
our definitions and in the reasoning based on them. We shall be applying 
the theory of vector spaces to a number of very different examples, and it 
is important to be quite clear to just what extent we can draw on the theory 
of vector spaces in each of these examples. This can only be done by 
developing the theory in a rigorous way, so that we know just which theor- 
ems are provable for all vector spaces and which theorems only apply to 
vector spaces with a particular property. We therefore begin by giving a 
precise specification, by means of a system of axioms, of what we mean by 
a vector space, and we introduce some of the most important examples of 
vector spaces. 


After this we develop the theory by looking at some of the elementary 
consequences of the axioms. One of the first significant results is a theorem 
which makes it meaningful to speak of the number of dimensions of a 
vector space. Just like the 3-dimensional space we live in, a vector space 
has a definite number of dimensions (indeed, this is one of the reasons for 
calling it a “ space"). The number of dimensions need not be 3, however; 
it can be any positive integer, and there are also *' infinite-dimensional " 
vector spaces, which we shall study later in the course. 


Finally we shall look at the subspaces of a vector space: these are simply 
subsets of a vector space which themselves satisfy the vector space axioms. 
Again, it is possible to prove some useful theorems about subspaces, but 
in this unit we shall not go deeply into the theory of subspaces. The material 
in this unit covers most of Chapter I of both K and N; but we shall not 
be asking you to read every word in these chapters. (If you find the unit 
easy and have the time to spare, you might like to read some of those parts 
of K and N which we have not asked you to read.) Both books include 
exercises and some of our exercises are different from these; so you will 
have an ample supply of problems to work through if you feel you need 
more practice with any point. 


1.1 VECTOR SPACES 
1.1.0 Introduction 


The concept of a vector space is the basis of the entire Linear Mathematics 
Course. It will be used, explicitly or implicitly, in every one of the units of 
the course. We can get a rough idea of a vector space if we regard it as a 
set whose elements can be (a) added together, and (b) multiplied by a real 
number, such that the result in either case is always an element of the set. 
For example, the set of ordered pairs of real numbers can be converted into 
a vector space by defining addition and multiplication by a real number 
as in the following examples: 


(L 2) + G, 4) = (13, 24) 


«63-3 


If you took the Foundation Course, M100, you will already have met 
several other examples of vector spaces. In fact, vector spaces are intro- 
duced there (in Unit M100 22, Linear Algebra I) by considering a particular 
example, a space of geometric vectors. (A geometric vector is defined as a 
set of arrows all having the same length and direction. If you need to 
revise geometric vectors, read Section 1-8 of K.) 


The approach to the subject used in the Foundation Course was to define 
geometric vectors and a way of adding them and a way of multiplying them 
by real numbers. 
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This addition and multiplication were then shown to satisfy certain rules, 
and in Section 22.2.2 of M100 22 these rules were listed and called axioms 
of a vector space. Since we are now trying to be more careful with our 
mathematical statements, we shall work the other way round and shall 
say that a vector space is defined as a set with addition and multiplication 
which satisfy these axioms. Then whatever we deduce from the axioms 
must hold (by definition) in every vector space. In the coming sections we 
first introduce these axioms and then consider some examples of vector 
spaces. 


11.1 The Axioms of a Real Vector Space 


A good introduction to the axioms which define a vector space is given in 
K. The authors’ approach is similar to that of the Foundation Course. 


READ Sections 1-1 and 1-2 of K, pages K1-8.* 


Notes 


(i) line I, page K1 R? was often referred to as R x R in the Foundation Course. 
Remember that R denotes the set of all real numbers. Whereas K uses a script 
type-face Я, we used an ordinary italic R. Also K uses bold-face type for vectors, 
whereas in the Foundation Course we underlined our letters to denote vectors. 
(ii) line 8, page КЗ What is meant here is that C[a, b] consists of all those func- 
tions whose domain is R or a subset of R which includes the subset [a, 5] = 
{x:a < x <b, хє R} and whose codomain is R, which are continuous at every 
point of [a, b]. Continuity can be thought of as meaning that the graph of each 
function in C[a, 6] does not have any breaks in it. C[a, 5] will be mentioned again 
in the first unit on differential equations. 
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Graph of function €C[0,1) Graph of function €C[0,1] 


(iii) line — 11, page K3 (i.e. 11 lines from the bottom of page 3) What is meant here 
is that for C[a, b] to be a vector space, f + g must also lie in the space; i.e. it 
must be a continuous function with domain [a, b] and codomain R. This property 
of f + g is intuitively obvious from the graphs on page КЗ, but to prove it we 
need the theorem that if f and g are continuous then so is f + g. This is a theorem 
in calculus which will not be covered in this course. 

(iv) Definition 1-1 on page K6-7 Notice that there are two “ hidden ” axioms in the 
statements preceding axiom (i) and axiom (v). The two hidden axioms, which 
are really the most important of all, assert first that a vector space is closed under 
addition and secondly that it is closed under scalar multiplication. This accounts 
for the fact that in the Foundation Course we listed ten axioms (see Unit M100 22), 
whereas here we have apparently only eight. 

(у) line J, page K7 The real numbers are called the scalars for the vector space *^ 
so that this scalar product is really multiplication of a vector by a scalar. 


The main point in the passage you have just read is Definition 1-1 on page 
K6. This definition incorporates all that we shall mean when we use the 
phrase real vector space. If this definition seems rather arid when read in 
isolation, try thinking of some examples of a vector space when reading 
through the axioms. (You will find a selection of such examples in section 
22.2.1 of Unit M100 22.) This will be particularly helpful in studying 
theorems about vector spaces. 


There are three types of vector space used as examples in this passage, and 
we would like to bring them to your attention again because of their 
importance throughout the course. The first of these types comprises the 
spaces К" introduced in Example 2 on page K7. For any positive integer л, 


* Remember that we do not intend you to work the exercises in a reading section unless 
specifically mentioned. Also remember that you were advised to mark the beginning, end 
and lines where notes occur before starting to read. 


the elements of А” are n-tuples, that is, arrays of real numbers (х1, х2, 
<.. X). If n= 1,2,3 we have alternative visual interpretations of А". 
If = 1, an element of А! is a “ 1-tuple,” (x,), and if we ignore the brackets 
we see that R! can be thought of as being the same as R, which is a vector 
space (as was pointed out in Example 1 on page K7). R can be visualized 
as the set of points on a line. The elements of R? are ordered pairs, which 
can be visualized as points in a plane; this was discussed in Section 1-1 of 
K. The elements of R? are ordered triples of real numbers and R? can be 
visualized as points in three-dimensional space. These last three examples 
are particularly useful as they give a way of visualizing the properties of 
vector spaces. 


The next type comprises spaces of the form C[a, b] whose elements are 
functions. We shall be particularly interested in this vector space in the units 
on differential equations in this course. 


The third type is the vector space P introduced in Example 3 on page K8. 
An element of P is a polynomial, that is, an expression of the form 


аа +ах+ т Ба 


where x is a variable (called an indeterminate), п is a positive integer or 
zero which, if a, #0, is called the degree of the polynomial, and ag, а;, 
+++) 4, are real numbers called the coefficients. The addition of polynomials 
and their multiplication by real numbers is defined in the usual way; for 
example 


(1 + 2x) + (3x +x?) = 1+ 5x +x? 
(-1) x (3#— 2x3) = —33 + 2x3. 


Note that if all the coefficients are zero we obtain the zero polynomial, 0. 
The zero polynomial is a member of P, and in future when a set of poly- 
nomials such as P is referred to as a vector space, the zero polynomial is 
always included. 


Every polynomial is associated with a function of the form 
pix(———— аа + х+ 5 +а,х  (xeR) 


which is called a polynomial function. We often use the same symbol, р say, 
to stand for the polynomial and the associated polynomial function. 


Exercises 


Test your understanding of what you have read by working the following 
exercises. (We suggest the minimum number of exercises that we consider 
you should work. If you feel you need further practice, then try some more.) 
The solutions are printed immediately after the exercises. 


1. (i) Page K5, Exercise 2. 
(ii) Page K5, Exercise 6. 
2. (i) Page KS, Exercise 12. 
(i) Page Кб, Exercise 19. 
(Note that K does not always distinguish between a function and 
its image. Thus tan x is used both as a function and the image of 
x under the function tan. Also the domain is not explicitly stated: 
it is assumed that the domain is as large as possible. Thus the 
domain of tan x is (x:x € R, cos x з 0}.) 
3. (i) Page K9, Exercise 4(a). 
(i) Page K9, Exercise 5(a). 
Page K9, Exercise 6. 
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Solutions 


The answers to odd-numbered exercises in K can be found at the 
back of K, page 725 onwards. We shall add notes to these answers 
where we think they might be helpful. We shall also give answers 
to those even-numbered exercises which we ask you to work. 
1. @ x+y=(14, -) 

a(x + у) = (—3, 2) 


<2(х+у) 2 


di) (f+ QQ) = х2 +х+1 
a(f + g)(x) = 2х2 + 2х + 2 


2. (i) This function belongs to C[— 1, 1]. 


Ix] 
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(ii) The function does not belong to @[— 1, 1] because it is 
discontinuous at 0. 


(x) 


| 


() ох, o; X; +азхз = (0, —1,4, —2) 
(i) cp, + 2 Pp up, = — xX? + 2x? — 8x +3 


This is not a vector space because multiplying such a poly- 
nomial by a non-integral scalar may give a polynomial with 
non-integral coefficients; e.g. if 


a=} and p=x?+2x+3, 
then 
op =}x?+x+3 


which is not in the set specified. 


1.1.2 Fields 


We have so far seen the definition of a real vector space, but this is not the 
most general type of vector space. In a real vector space, we require that if 
x is in the space then so is ах with о any real number; but instead we could 
have specified a different set of possibilities for «, for example, complex 
numbers or rational numbers. (Complex vector spaces, in which « is 
allowed to be any complex number, are very useful in solving linear dif- 
ferential equations, as we shall see later in the course.) To define a general 
vector space we replace the requirement that « be real by a requirement 
that it be drawn from a set satisfying a certain set of axioms, which are 
satisfied by the real numbers, the complex numbers, the rational numbers, 
and some other more special sets too. Any set satisfying these axioms is 
called a field and its elements (in the context of vector spaces) are called 
scalars. 


To see the details of how a field is defined, we turn to N. 
READ from the word Definition on page N6 as far as Definition on page N7. 


The 11 axioms for a field together with the 10 axioms of a vector space 
Tay seem a formidable list. In a little while you will not find this so. It 
becomes a habit to think in terms of specific examples, even when carefully 
proving very general theorems. Also, the notation helps us remember the 
rules; we use the ordinary notation for multiplication and addition. 


You may find it helpful to notice that the first five field axioms F1-5 іп N 
are merely stating that (F, +) is a commutative group. (See Unit M100 30: 
the concept of a group is not essential to this course, although it can some- 
times be useful. See also page N8.) The next five, F6-10, state that if we 
remove 0 from F, then the remainder is a commutative group for multi- 
plication. So we can replace the 11 axioms by 3, viz: 


(i) (F, +) is a commutative group 
(i) (Fy, +) is a commutative group, where F, is F without the identity 0 
for + 
(iii) - is distributive over +. 


We do not ask you to remember the set of axioms of a field; we merely 
wish to draw your attention to its existence and the fact that any results 
proved for vector spaces in general apply to vector spaces over any field. 
In most practical cases the field is the set of real numbers or the set of 
complex numbers. 
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1.13 The Axioms for a General Vector Space 


We next have the axioms for a general vector space; that is, a vector space 
with a general field F as the scalars. 


READ from Definition on page N7 to “... satisfying these conditions” 
about halfway down page N8. 


If we compare the axioms listed on pages K6-7 with those listed in IN 
then there are three points to notice. The most obvious is in the notation: 
K uses bold-face roman letters for vectors and Greek letters for scalars but 
N uses Greek for vectors and italic for scalars. This is just a notational 
difference and nothing more. The next point is that N has two more 
axioms than K, namely Al and B1. These axioms (which we have already 
referred to earlier in a note on K) are sometimes called closure axioms and 
make explicit the requirement that addition and scalar multiplication do 
give elements of the vector space. Finally, there is the difference we have 
already mentioned that K is defining a real vector space and therefore 
requires F to be the field of real numbers, whereas N defines a general 
vector space and so F is any field. 


1.1.4 Examples of Vector Spaces 


The next reading passage lists nine examples of vector spaces. 


READ the rest of page N8 and continue to the end of Example (9) on page 
N9. 


Do not worry about the details of Examples (4), (5), (6), (7) at this stage 


but pay particular attention to Examples (1), (3), (8), (9). What do you 
notice about these latter examples ? 


Notes 


(i) line — 12, page N8 For the terminology relating to polynomials, see the end 
of sub-section 1.1.1 of this text. 

(ii) line —4, page N8 A "real-valued function of a real variable" is what we 
called a real function in M100. That is, a function whose domain and codomain 


are Mi а subsets of R. The “ values" of a function are what we called its images 
in M100. 


The thing you should notice about Examples (1), (3), (8) and (9) is that they 
are the same as the examples we met in K but with a general field F of 
scalars instead of the field R of real numbers used in K. Example (2) is an 
obvious extension of Example (1). Whatever » we use, all the vectors in 
P, are also іп P; for example, Р, consists of all polynomials in x of the 
form a + bx, where a, b are in the field F. Examples (4), (5), (6) require 
theorems to verify 41 and B1 and these may be theorems you have not yet 
met (and which will not be proved in this course). Example (4), for example, 
requires the theorem referred to earlier, that the sum of two continuous 
functions is itself continuous. Example (7) is particularly interesting 
because it illustrates the possibility of applying vector Space theory to the 
study of differential equations. This application was found very fruitful 
in Unit M100 31, Differential Equations II, and we shall exploit it further 
in the units on differential equations in this course. 


Exercise 
With the notation as in N, let V be the set of all polynomials of degree 3 


and let F — R. Is Va real vector space? (Hint: Compare this set with Example 
2 on page N8.) 
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Solution 


There are a number of reasons why this is not a vector space. For 
instance, Al is not satisfied: for example, if 


а= хі + 3х2 +2 
апі 
В = х + 3х + 5, 


then а + f is a polynomial of degree 2 and so does not belong to 
V. Another reason is that A3 is not satisfied. 


1.1.5 The Zero Vector and the Negative of a Vector 


The last passage in the current section of N covers some simple manipula- 
tions based on the axioms defining a vector space. You may like to 
compare it with Section 1-3 of K. You may find the one-line proofs hard to 
follow, and there is no need to follow the argument in detail; we do ask 
you, however, to note the results which we summarize below. We shall be 
commenting on one or two such proofs later on. 


READ the remainder of Section 1 on pages N9-10. 
The results proved in this section are: 


() the zero vector is unique; 
(i) the negative (additive inverse) of a vector is unique; 
(Ш) 0x = 0, for any vector « (the zero scalar times any vector is equal to 
the zero vector); 
(iv) a0 = 0, for any scalar a (any scalar multiple of the zero vector is 
equal to the zero vector); 
(v) (-1)- —a (see F8 and F4 for the definition of — 1). 


1.1.6 Summary of Section 1.1 


This section contains the axioms for a field and the axioms for a vector 
Space. 


A field is any mathematical structure satisfying the axioms F1 to F11 on 
page N6-7. The only fields of importance in this course are the real 
numbers and the complex numbers. 


A. vector space (over some given field F) is any mathematical structure 
satisfying the axioms 41 to 45 and ВІ to B5 on pages N7-8. In particular, 
the set is closed under the operations of addition, and multiplication by any 
scalar (i.e. element of F). 


You are not expected to memorize these lists of axioms, but you should be 
able to use them to check whether a given structure is, or is not, a vector 
space. 


This section also introduces three important examples of (real) vector 
Spaces: 


К", the space of n-tuples (a;, a2, ..., @,) of real numbers 
Са, b], the space of functions continuous on the interval [a, b] 
P, the space of polynomials with real coefficients 
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1.2 LINEAR DEPENDENCE AND INDEPENDENCE 
1.2.0 Introduction 


Having defined a vector space as (loosely) a set of objects which is closed 
under the operations of addition, and multiplication by scalars, we now 
look at some of the consequences of our definition. In particular, if « and f 
are two given vectors, what can we form from them using the two vector 
space operations, one after the other? For exaraple, we could add « to В 
and multiply the result by a scalar, obtaining a vector such as 


2(« + В) = 2a + 28; 


or we could multiply both о and f by scalars and then add the resulting 
vectors, obtaining a vector such as 


За + (- 8 = 3a — 28. 


Expressions of the form 2« + 2f ог 3« — 48, or in general аа + bB, where 
a and b are scalars, are called /inear combinations of the two vectors « and 
B. Similarly, the most general linear combination of three given vectors 
a, B and y is 


aa + bB + cy, 


where a, b and c are scalars. This idea of taking linear combinations of 
elements of a given set of vectors is very useful because it combines the two 
basic operations of addition and scalar multiplication; for example, 
we can now define a vector space (loosely) as a set of objects which is 
closed under the “ operation” of taking linear combinations. 


Given any set of vectors in a vector space, we can ask the following two 
questions about it. 


1. Can every non-zero vector in the space be. expressed as a linear com- 
bination of the vectors in the set? If the answer is yes, the set is 
said to span the space. 

2. Can the zero vector be expressed as a linear combination of the 
vectors in the set, in a non-trivial way (that is, in a way. other than 
0 = 00+ 06 +--++ Oy)? If the answer is yes, the vectors are said 
to be linearly dependent. 


y-axis 
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x-axis 


The geometric vectors а and В span The geometric vectors c, p, and t 
the plane of the paper, because any are linearly dependent, “because 
other geometric vector у in the а+т+2р= 0 

plane can be written іп the form 7 7 77 

px yf 


Intuitively, it would seem that the more vectors there are in the set, the 
more linear combinations it has and therefore the more likely it is to span 
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the space and the more likely it is to be linearly dependent; thus we might 
expect to find some connection between the number of vectors in a spanning 
Set (i.e. a set of vectors which spans the space) and the number in a linearly 
dependent set. Such a connection does exist, and the present section leads 
up to a theorem which provides it. It is called the Steinitz Replacement 
Theorem and is the first important theorem in this course. 


This section is based on Section 2 of Chapter I of N. The same material is 
also treated on pages 18-20 of K. We shall not specifically ask you to 
read the treatment in K, but if you are having difficulty you may find it 
helpful to consult K for a different point of view. 


If you have had a quick look at Section 2 (page N10 onwards), you will 
have seen that there are seven theorems, each with its proof. In fact, six 
of these proofs only deduce simple facts about linear dependence and span, 
Some of which are used in the proof of the important theorem of the section, 
Theorem 2.7. We shall not ask you to read all these theorems and their 
proofs. What we shall do in this section is to illustrate the ideas we will 
need to prove the key theorem of this section, the Replacement Theorem. 


1.21 Linear Dependence 


In this sub-section we are interested in linear combinations of vectors which 
give us the zero vector. We first look at an example. 


Let us look at the real vector space R?: the vectors in R? are ordered pairs 
of real numbers, (a, b). We pick four vectors from R?:a, = (1, 1), а = 
(3, — 1), аз = (1, —1) and о, = (—5, 1). We have chosen them carefully: 
if we add them we get 


0, +O. 43 04 = (1, 1) + (3, 21) + (1, 21) + (-5, 1) 
=(14341<3,1<1<141) 
= (0, 0) 
= 0, the zero vector іп R?. 


Thus there is a non-trivial linear combination of a, ..., «4 which is equal 
to the zero vector. In other words, «|, 45, аз, «, are linearly dependent. 
We could write this in another way: 


= — (ty + Oy + 03), 


which tells us that «, is a linear combination of a, х, «3. This is no acci- 
dent: if a set of vectors is linearly dependent, then it is always possible to 
express one of them as a linear combination of the others. (We illustrate 
that not every vector in a linearly dependent set can be expressed in terms 
of the others by the following linearly dependent set in R? 


(0, – 1,0), (—2, 2, 0), (1, 1, D). 
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LM 1.2.0/1.2.1 


We have linear dependence since 
2(1, —1, 0) + (—2, 2, 0) + 0(1, 1, 1) = (0, 0, 0). 


But it is not possible to express (1, 1, 1) as a linear combination of the 
others.) 


Suppose now that we consider a smaller set of vectors, say © and аз, 
and try to find a linear relation between them—that is, a linear combination 
that is equal to the zero vector. 


This means looking for real numbers a and b such that 
ac, + ba; = 0 

ie. 
a(l, 1) + b(1, — 1) = (0, 0). 


Carrying out the indicated scalar multiplications and additions on the left 
side, we get 


a(l, 1) +80, —1) = (a, a) + (b, —b) 
=(а+ b, a Б). 


Jf there is a linear relation between a, and a, this vector (a + b, a — b) 
must be the vector (0, 0). This implies that the corresponding components 
are the same, i.e. that 


a+b=0 
and 
a—b=0, 


from which it follows that a = 0 and b = 0. Thus the only linear relation 
between a, and оз is the trivial one, 


Oa, + Ооз = 0. 


The set of vectors (a, оз) is therefore not linearly dependent; we say that 
it is linearly independent. 


The method of generalizing these ideas to arbitrary sets of vectors in an 
arbitrary vector space is described in the next passage of N. 


READ Section 2 pages N10-12, up to but not including Theorem 2.1, omitting 
the paragraph beginning “It is clear that....” on page N11. 

Notes 

(i) line d, page N11 We require that only a finite number of coefficients in an 
expression У аа, are non-zero, because we have as yet no way to give any 


meaning to the sum of an infinite set of vectors. We shall see how to d i 
ате а А e 
infinite sums later in the course. шы. 
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(ii) line 17, page N11 This piece of proof has been printed on one line to save 
space. It may help you if you write such proofs out for yourself on several lines. 
For example, this particular line could be rewritten to distinguish each step in 
the following way: 


‘For if ae = 0 with a з 0, then 


(by axiom B5) 

(by F9, since a # 0) 

(by B2) 

(since a« — 0) 

(by the first paragraph on page N10) 


A point to note about this proof is that it is an indirect proof. (See Unit M100 
17.) To see why it is a proof it is perhaps simplest to convert it to a proof by 
contradiction. 


We start with the hypothesis а € 0, and by № argument reach а =0. This 
contradicts the original assertion that our set consists of a.non-zero vector, æ. 
Thus our original hypothesis, a # 0, is disproved; i.e. we have proved a — 0. 


Alternatively, do not read such proofs at all but try to prove the result oneself. 
This will often require more time and may sometimes lead to a different proof 
altogether. For instance, in this case, one might well come up with the following 
proof. 


аа = 0 а%* 0 
=a} (aa) —a-!0 (F9) 
=(а-!а)ә = 0 (82 and first paragraph on page N10) 
le=0 (F9) 
a=0 (B5) 


Gii) line 2, page N12 (ai) is a notation for a set of vectors. The letter i is allowed 
to range over the integers. Thus both the following sets could be denoted by {æ} 


{æ} = (o5, оз, e), a finite set 
(ou) = (o5, w2, «з, &4,...), an infinite set. 


(v) line 10, page N12 Example (1) is on page N8. A monomial is a polynom- 
ial whose coefficients are all zero except one. 


Exercise 
Page N14, Exercise 1. 


Solution 


The answers to selected exercises can be found at the back of N 
(page 325 onwards). We shall add notes to these answers where 
we think they might be helpful. We shall also give answers to 
those exercises which we ask you to work and to which N does 
not give answers. 


For this exercise, the answer given by N is brief. Here is a fuller 
solution. 


Can we find real numbers a, b, c and d, not all zero, such that 
a(x? + x +1) + d(x? — x —2) + сх? +x 1) + d(x — 1) 
is the zero polynomial? 
Rearranging gives 
(a+ b cy? +(a—b+c+d)x+(a—2b-—c-d) 
This expression is the zero polynomial if, simultaneously, 


a+b+c=0 
a—b+c+d=0 
a—2b-c—d-0. 
Since there are 4 unknowns and only 3 equations, there is not 
enough information to determine a, b, c, d uniquely. If we choose 
a value for one of them arbitrarily, the other values are then 
uniquely determined. 


Let d — 1, say. 
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LM 1.2.1 


Hence we obtain a = 3,b = }, c = — 14. 


Thus the given polynomials are linearly dependent, and we can 
express p4, say, as a linear combination of the other three: 


ра = —Àpi — Зра + 14рз- 
1.2.2 A Theorem on Linear Dependence 
The object of this sub-section is to understand Theorem 2.7 on page 
N12. 
READ Theorem 2.1 and its proof on page N12, 


but if you are not sure that you have understood the, statement of the 
theorem or its proof, work the following exercises and then read the theorem 
again. 
Exercises 
1. For the following vectors in А? 
В, = (1, 1), В› = (3, —1), Вз =(1, -1) 
and о = (6, — 4), we can easily show that 
а = – В, + 28, + Вз 
i.e. а is a linear combination of {8;}. 
If further 
Э = (1,0), у = (0,1) 


express each f as a linear combination of {y,} and hence express « as а 
linear combination of the (yj). 


(Although this is not the quickest way to express а in terms of the 
{у}, we want to illustrate the theorem.) 


2. Lety 21x, р = 1 х2, уу = 1 - x — x? be three vectors іп the 
real vector space P, of polynomials in x of degree at most 2. 


(i) Write the vectors f, = 1, f; = x, Йу = x? as linear combinations 
of (yy Y2; Уз}. (Hint: try adding y, and y2.) 
(ii) Use your solution to (i) to write 


a =2+3x—x? 


as a linear combination of (y,, Y2, y;). 


Solutions 


l. By = 25 В = Зу, — V2, B3 = у; — m. 
Therefore, since 
a = – В, + 2B. + Вз, 
а= —(у, + Y2) + 2(Зу, — V2) + (у у) 
= =}; — У + бу — 2y2 + Yı — у 
= бу — 472. 


If you are using this exercise to understand the theorem, then 
you should notice that а = У, b; Bis 


where 


b, = —1, Б, =2, b = 1, and Bi= у усу, 
where 


Cy = б; = 1; суу = 3, C22 = 1, сур = 1, су, = ~1, 
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2. (i) Wt+y2=24+x—x* 


=1+ 73. 
Hence В, = у; +72—73- 
п=1+х 
= В; +В, 


=n +72 -73 Bi 
so that f; = y4 — y;. 
Finally 
Ёз = —уз +1 
72+ +7 – Уз 
=%1— Уз. 
That is fy = y, + 33 — 33. b2 = уз — 32. Bs 2 — Уз 
(ii) a=2 + 3х – x? 
= 2f, + 30; — Вз 
= 27; + 29 — 273 + Зуз — 3y2 — у, + уз 
= — 72 +23. 


1.2.3 The Set Spanned by a Set of Vectors 


П] 


We have so far considered what it means to say that one vector is a linear 
combination of certain other vectors. What we want to consider now is 
what happens when we start with a set of vectors, A say, and form all the 
possible linear combinations of these vectors. We will get a larger set of 
vectors; we denote it by (4) and call it the set spanned by A. 


Let us illustrate this with the four vectors 
&, = (1, D), æ: = (3, – 1), аз = (1, — 1), æ, = (— 5, 1) 


in R?. Suppose first that А just contains о; = (1, 1) and we want to find all 
linear combinations of o. From the definition of linear combination we see 
that any vector f which is a linear combination of o, will be of the form 
В = aq, = (a, a) where a is a real number. Conversely, any vector (a, а) = 
аб, is a linear combination of œ, and this shows that the set spanned by 
o, is the set of vectors 


<a) = {(@, а):ає R}. 


We can represent the elements of R? in many ways: in the diagram we 
show vectors as points, rather than as geometric or position vectors as 
before. 
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Now suppose we let А = (u,, х} and we try to find (A45. Again we see from 
the definition of linear combination that 
<А) = (aa, + baz:a, b e R}. 
That is (4) consists of all the vectors we can get of the form aa, + Боз, 
for all possible choices of a and b in R. We look at an arbitrary vector Ё 
in <A). 
В = ae, + ba 
= a(l, I) + b(3, — 1) 
= (a + 3b, a — b). 
We therefore have 4) = ((a + 3b, a — b):a, be R} 
We can look at a diagram to see what is happening. When b is zero we 


have just (a5, which we have seen can be represented by a line in the 
plane. 


Now suppose that b = 1; then we have the set of vectors (a 4-3,a— 1) 
and as we let a take all values in R we again get a line in our diagram. 
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If we try some other values for b, we get other lines. 


It seems from the diagram that by taking all possible values for a and b we 
will get a set of lines covering the plane. That is, the diagram suggests that 
Хоц, %2>* = R?. Can we, in fact, prove this? In order to prove that 
<ar, ау = R? we have to show that о, а) and R? contain the same 
vectors. Now a, a are in А?, and because А? is a vector space, any linear 
combination of a, а> must be in R?. We therefore have that (0, а) © К. 
To complete the proof that оу, a» = R?, we have to show that R? c 
о, а); that js, that every vector in R? is in <a, &;). Suppose that f € R? 
and that f — (c, d): we have to show that 


В = ao, + ba, 
for some a and b. That is 

(c, d) = (a + 3b, a — b) 
whence 

а+ 3b = с, 

a-—b=d. 


; А -4 
Solving these simultaneous equations for а and b we see that b= —— 


c 4 3d 
4 


anda= . So, if f = (c, d), then 


с+ 3d c—d 
ф== H+ 4 a 


ie. fl is in о, 9), and so R? € (a, а). This completes the proof that 
а, 9) = К. 

We could continue by considering <a,, «2, х3), but for the moment we 
have seen enough to illustrate the idea of span. 

READ the two short paragraphs on page N12 between Theorem 2.2 and 
Theorem 2.3. 


Notes 


(i) line — 7, page N12 Since the empty set is useful for dealing with intersections 
and subsets of arbitrary sets we would like to talk about <0), the set spanned 
by the empty set. The most sensible way to do this is to make it a definition that 
40» is to be the set containing the zero vector alone. 


* <a, æ) is an abbreviated form оГ, «2}>, the set of vectors spanned by the set {а,ә}. 
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(ii) line —4, page N12 Here we see one use of symbols. The statement of 
Theorem 2.1 takes 2 lines of print, but after defining the symbol < > the statement 
of the theorem is reduced to half a line, 


“IFAC <B> апі BC<C> then Ac <C>.” 


If such lines of symbols worry you, try expressing them in words: in this case we 
have “If A is contained in the set spanned by В and B is contained in the set 
spanned by C, then A is contained in the set spanned by C." You can go one stage 
further and replace the words “is spanned by” to get: “If each element of A 
is a linear combination of the elements of В and if each element of В is a linear 
combination of the elements of C, then ... " and we are back at the statement of 
Theorem 2.1. 


In this case our introduction and notes may seem to you to swamp the 
piece of text that we asked you to read so that we might have done better 
without N. This may or may not be true, but we remind you that one of 
our objectives in this course is to enable you to read ordinary mathematical 
texts. We hope that by the end of this course you will be able to read books 
like N with much less help than we are giving at present. 


At the beginning of this sub-section we looked at the set spanned by 
a, = (1, 1) and the set spanned by (a;, a}, «2 = (3, — 1), but we did not 
go further and look at the set spanned by {a,, о, %3}, «3 = (1, — 1). Let 
us see what happens if we do consider <(1, 1), (3, — 1), (1, — 1)». 


We have seen that 


<ar az) = R? 
and hence 
оз € (05, 22). 


In fact (1, 21) = —4(1, 1) + 3G, — 1), i.e. 
[E 


In other words, æ, is a linear combination of a, and о. A point which is 
perhaps not so obvious is this: suppose fj is іп (a, а, 93); then B = 
ag, + bx; + соз for real numbers a, b, c. But «у = — јоу + јо, , and so we 
can substitute for оз. 


c c 
В = au, + ba, – + 5 M2 


c c 
= (4—5 at bt, 03. 
Now this tells us that ff is in (o, 0). That is, because a; is linearly depen- 


dent on a, and a, every vector in Ca,, a2, аз) must be in (o, ау. In 
symbols 


о, а, 93) © Coty, 225. 

Conversely, every vector in (a,, «> has the form 
aa, + ba, = aa, + Баз + доз 

and so must be in <a;, «2, «35; that is 
01,0) € (0, а, 93). 

Putting these two inclusions together, we get 
01,95, 43) = (0, 025. 


What we have illustrated here is the statement of Theorem 2.5 on page 
N13, which you should note. The notation A — {шу}, used in that theorem 
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means the set A with the element о, removed. In general if A and B are two 
sets, A — B is the set A with those elements removed which are also in B. 


A B 


Exercises 


1. Describe in geometrical terms the set spanned by each of the following 
subsets of vectors in R?: 


G (1,0) (answer: the x-axis) 
Gi) 0,1) 
Gii) {(1, 0), (0, D) 
Gv) (0,0), (2, 0) 
(у) ((00) 
(vi) @ (the empty set) 


2. In the space P, consisting of all real polynomials in x of degree 2 or 
less (together with the zero polynomial), which of the following state- 
ments are true? 


(i) x? —x-1le<x?,x+1> 
G) x-x-1eQ2x-1» 
(ii) QU, x 1 =P, 
(v) <x?, x, 1) = P, 

(у) «2, x? — x, x, 1) = P 
(vi) <x? — x, x, 1) = P, 


Solutions 


1l. (i) The x-axis 
(i) The y-axis 
(iii) The whole plane 
(iv) The x-axis 
(у) The origin 
(vi) The origin (see page N12, line —7) 


2. () True, since x? — x — 1 = b? + (—1)(x + D. 

(ii) False, since every polynomial in Qd, x + 1) is of the 
form ax? + B(x + 1), and x? — x + 1 is not of this form. 

(iii) False, since the result of (ii) shows that x!—-x-lisin 
P, but not in (x?, x + 1). 

(iv) True, since the general element of Ру can be written as 
ax? + Bx + y, which is a linear combination of x*, x, 
and 1. 

(V) True, since (x?, x, 1) spans P, and adding more vectors 
to the set cannot decrease (x?, x, 1). Also, adding the 
vector x? — x to (x?, x, 1) cannot increase <x’, x, 1) 
since x? — x e (x?, x, 1). 

(vi) True, the general element of Рз can be written 


ax? + Вх + y = а(х? — x) + (0 + В)х + yl 


and is therefore a linear combination of x? — x, x, and 
1. This is an example of Theorem 2.5 with A= 
{x?, x? — x, x, 1} and a = x?, since x = (х? — x) +x. 


1.2.4 The Replacement Theorem 


In this section we discuss Theorem 2.7 on page N13. This theorem is prob- 
ably the most important in this unit because from it we can arrive at the 
concept of dimension for a vector space, as we shall see in the next sections. 
Because of its importance, and the importance of the technique used to 
prove it we will work through the proof in detail. 


READ the statement of Theorem 2.7 on page N13. 


Before working through the proof let us try to see what the theorem is 
saying. One way of doing this is to think of an example where this theorem 
could apply. We want a vector space V and a finite set of vectors which 
spans V. The example we have considered so far is R?, and we saw in the 
previous section that R? is spanned by (a,,«;) where o, = (1, 1) and 
a, = (3, — 1) i.e., R? = (a, а). 


So we have a vector space R? and a finite set (o, а) which spans R^; 
what then does the theorem tell us about the vector space 2? The 
theorem asserts that any linearly independent subset of В? can contain at 
most 2 elements. Putting this another way, if we pick any subset W of R? 
which contains more than 2 elements, then W is a linearly dependent set. 
For example, in the preceding sub-section we saw that ((1, 1), (3, — 1), 
(1, —1)) was linearly dependent in R?. Theorem 2.7 tells us this immed- 
jately. Surely this is a most surprising statement about a vector space to 
deduce from such an innocent assumption about a set of vectors spanning 
the space! 


Let us consider another example, the vector space P, of polynomials of 
degree at most 2. We can pick out the polynomials p, = x°, p; = х, 
р» = 1; then it is easy to see that (pi, P2, рз) = Рз because if p = ax? 
+ bx + с is any vector in Рз, then we have р = ap, = bp; + cp, and so p 
is in <р;, рз, P3). Thus, Ру is a vector space spanned by a finite set of 
vectors containing 3 elements and so the theorem tells us that any linearly 
independent subset of P, contains at most 3 vectors: any 4 vectors in P4 
will be linearly dependent. 


What about a proof of this theorem? The method of proof that we are 
going to give here is essentially that given by N. The method of proof in 
fact explains why it is called the Replacement Theorem. 


We first look at the information we are given. We have a vector Space V 
and a finite set of vectors A = {a,, &;, ..., à) which spans V. We are also 
given a subset of V, B say, which is linearly independent, that is there is 
no non-trivial linear combination of the vectors in B which gives us the 
zero vector. (B, of course, cannot contain the zero vector.) We suppose 
B= (fi, P2, ...) where the dots indicate that B may have any number of 
elements. This is all the information we are given 


A= (n, 05, . v., t), n finite; A spans V 
B= (f, В,,...}; B is linearly independent, B c y. 


To prove the theorem we go through a “replacement process”; we replace 
each а by a f in turn in such a way that at each Stage we still have a set 
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which spans V. This replacement process needs justification, but schematic- 
ally it looks like this: 


A = (0,05,0,..., a) A spans V 


i replace a, by fj, 


Ay = (f, 2,,2,,..., 0) | A, spans V 


{ replace a, by fj; 


42 = (Bi, Bas 05, ..., 0) | A, spans V 


{ replace оз by f 


Suppose in fact that we do have some way of doing this replacement process 
in such a way that each of the sets A,, A2, ... still spans V; then two 
possibilities can occur. 


(i) Either the set B contains n or fewer vectors, in which case our re- 
placement process will end with no fs left over, or 


(i) we reach A, = (fi, B2, ..., B... Ba}; each a has been replaced and 
there are still some Bs left over. 


In case (i) everything is fine. B contains at most п vectors in the first place 
for this case to occur, which is just what we wanted to prove. 


In case (ii) there is at least one fj left over, say B,4,. Then A, = (f, 82, 
..., By} spans V and 8,4, € V, so agi is a non-trivial linear combination 
of (f, В, ..., Bat- But this contradicts B being linearly independent! This 
means that if B is linearly independent, case (ii) cannot occur and this 
replacement process must end in case (i). That is, B contains at most n 
vectors. 


So the whole proof rests on this replacement process, on being able to go 
from A to A, to A, and so on, up to A,, and at each stage having a set 
which spans V. Note how important it is that we do have sets which span 
V: the fact that A, spans V enables us to eliminate case (ii). 


Let us look more closely and see how we can do this replacement process. 
We look at the first step. We have A spanning V and we want to replace 
an а by a 3 in such a way that the new set, 4,, spans V. 


We first add fj, to A giving {B,} о A = (f, %, 63; ..., &,). Since A spans 
_V, By is linearly dependent on A. So by Theorem 2.5 


{Bi} о AD = XB) o 4 — (85 = KAX. 


Hence, since A spans V 


{Bi} о AD = V. 


We now want to remove ап « from (f) о A to obtain a set which still 
spans V. To apply Theorem 2.5 we must make sure that the а we remove is 
linearly dependent on the other elements of (fj) U A. Since A spans V and 
B, #0, we have 


By = aya, +4202 t a0, 


where not all the a; are zero. Renumbering the vectors in A if necessary 
so that a, # 0, we have 


1 az a, 

— В Ha toa tty. 
1 1 2 

а, а, а, 
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Rearranging 
1 а а, ) 
а= В – |а, + + 9, |, 
izh-(Qeec Rm 


ie. a, is linearly dependent on the other vectors in (f) о A. Thus by 
Theorem 2.5 


ФВ} o 4» = {Bi} o 4» — f) 


= (f, ny 03, 4) 


= (Ay). 
Thus we have shown first that 
{Bi} о AD = У 


and secondly that 
ФВ) o 4» = <А,). 
Putting these together, we have 
(Ap = У 


which is just what we wanted to show. We have replaced one « by a Вапа 
obtained a set of vectors A, which spans V. This is at least the first stage 
in the chain of replacements successfully completed. 


What about the next stage in the replacement process? We begin by adding 
fl; to A, and, by the same argument as before ($, is linearly dependent 
on A,), we have 


(o 4» = И 
by Theorem 2.5. 


Now we want to show that one of the as can be removed from {$2} U 4, 
in such a way that the new set spans V. 


Since A, spans V and fl; € V 
Bo = bibi + bz tz + bzta +++ bnan 
where not all the 5; are zero. 


Now if b; =b, =: = b, = 0, then fj; is a linear combination of ,, 
and В = (f, B2, Ёз, ...) would not have been linearly independent— 
contrary to our original statement. Thus, one of bz, b3,..., b, is non- 


zero, and again renumbering «z, @3,...,&, if necessary, we may take 
b; #0. 


Thus 


We can now go through the same argument as in the first replacement 
process, using Theorem 2.5 again to give 


€(82) o А) = ({B2} o А, — (3? 
= (fis Bas 03, 04, ..., а, 
= (AD). 


Since we have already shown that 


8:304» = V 
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we have 
(45? = И, 


So again we have been successful; the vector we are now calling «; has 
been replaced by f, and we still have a spanning set for V. 


Well, we just go through this process again and again, at each stage 
possibly renumbering the as that are left, but at each stage getting a set 
which spans V. So we see that the replacement of as by Bs on which the 
proof of the theorem rests can be justified. There are two important points 
about this theorem: one is the theorem itself which we shall use in Section 
1.3; the other is this technique of replacement which we shall use later to 
derive some important consequences. If you have time, try to review the 
proof of this theorem by reading the one given in N (page N13). 


Exercise 


The vector « = (3, 2) is linearly independent in А?. Use the replacement 
process on the spanning set ((1, 0), (0, 1)} for R? to find another vector 
В є R?, which together with « spans R?. 

Solution 


Following the replacement process we wish to take out one of 
(1, 0) and (0, 1) from the set 


{о, (1, 0), (0, 1)} 


such that the set remaining spans R?. We do this by using the 
fact that {(1, 0), (0, 1)) spans R? and hence write « as a linear 
combination of ((1, 0), (0, 1)) 


« = (3,2) = 3(1, 0) + 20, 1). 
Solving for (0, 1) gives 


0,1) =$-541,0). 
Thus 

<a, (1, 0), (0, 1)> = <(1, 0), (0, D» = R? 
and 

<a, (1, 0)> = <a, (1, 0), (0, 1). 
Hence 

<a, (1, 0)> = А? 
i.e. 

В = (1,0). 


Alternatively, we could have written 
« 2 
=--—=(0,1 
(L0Q=3-3 (0, 1) 


and arrived at 


В = (0, 1). 
In this exercise, one could obviously solve the problem very 
easily by many other means. But that is not the point; suppose а 
similar problem were posed in P,, say. The method remains the 
same: we have an effective algorithm for its solution. 
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1.2.5 Summary of Section 1.2 


In this section we defined the terms 


linear combination (page N11) 
linear relation (page N11) 
linearly dependent (page N11) 
linearly independent (page N11) 
span i (page N12) 


We introduced the notation (4) for the set spanned by the set A. 
We considered three theorems in particular: 


1. (2.1, page N12) 
If о is linearly dependent оп (f;) and each £; is linearly dependent 
on (yj) then a is linearly dependent on {yj}. 

2. (2.5, page N13) 
If a, є A is dependent on the other vectors in A then 


(A) = (A — {a}. 


3. (2.7, page N13) 
The Replacement Theorem. If a finite set A= (04, 05, ..., %,} spans 
V then every linearly independent subset of V contains at most n 
elements. - 


We studied the replacement process used to prove the Replacement 
Theorem. 
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13 BASES 
1.3.0 Introduction 


In the present section we use the ideas of linear dependence and span, 
together with the replacement theorem which connects them, to arrive 
at a definition of the dimension of a vector space. This idea of dimension 
considerably simplifies some of the results about linear dependence and 
span which we obtained in Section 1.2. We know already that the space 
we live in has 3 dimensions, that a plane has 2 dimensions and a line 1, 
but these ideas are not very precise, and it is not clear at this stage whether 
the idea of dimension applies to all vector spaces or whether it is a par- 
ticular property of geometrical spaces. By defining dimension in a way 
that depends directly on the axioms of a vector space, we shall show that 
the concept of number of dimensions applies to all vector spaces. 


The argument proceeds from the assumption that the vector space contains 
a set of vectors which is both linearly independent and a spanning set. 
Such a set is called a basis, and the number of elements in it is called the 
dimension of the space. The main thing we have to prove, to justify calling 
this the dimension, is that all bases in a given vector space contain the 
same number of elements. Thus, the number of elements in any basis is a 
characteristic of the space itself and does not depend on the particular 
basis chosen. In fact this number, the dimension, may be said to determine 
completely the structure of the vector space; for we shall see that any two 
vector spaces with the same dimension over the same field have precisely 
the same structure—i.e. there is an isomorphism (structure-preserving 
mapping) connecting them. For example, the geometric vectors in a plane 
and the complex numbers are both real vector spaces of dimension 2, 
and so there must be an isomorphism between them. 


1.3.1 Definition of Basis 
READ Section 3 on page N15 as far as but not including Theorem 3.1. 


Notes 
(i) line 15, page N15 Example (1) is on page N8. The notation 
{a =x'|i=0,1,...}. 
means the set whose elements are 
2 


ао = 1, а = х, аз = х?,...; 


i.e., the basis is the set (1, x, x?,...}. 

(ii) line 17, page N15 The definition of P, is in Example (2) on page №. 

(iii) line 21, page N15 This is just a compact way of saying that R? has the basis 
{ол = (1, 0), ог = (0, 1)}; that R? has the basis {(1, 0, 0), (0, 1, 0), (0, 0, 1)) and 
that, in general, R^ has a basis where the ith basis vector a, has zero entries every- 
where except in the ith place where the entry is 1. In the case of R? the proof that 
(1, 0) and (0, 1) span the space is that any vector (a, b) in R? can be written in the 
form a(1, 0) + 6(0, 1). The proof of independence is that 


c(1, 0) + 4(0, 1) = (0, 0) 
implies 
(с, d) = (0, 0) 
ie. 
c=d=0. 
The proof for А?, etc. is similar. The Kronecker delta occurs frequently in 


mathematics: it is worth getting used to it. 


There are three important points in this reading passage. The first is that 
a basis spans the vector space; the second is that a basis is a linearly 
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independent set of vectors, and thirdly that every element in a vector space 
has a unigue representation as a linear combination of basis vectors. We 
shall return to this third point in sub-section 1.3.3. 


Example 


As opposed to exercises which are meant for you to work before looking 
at the solutions, examples are meant to illustrate the methods and ideas 
in the current section. But, if you are doing well with the unit, you can 
turn an example into an exercise by just reading the statement of the 
problem and then trying it for yourself before reading the solution. 


Let p, = х? - l, pp=x+1, ру — x? + x + 1 be three vectors іп Рз, 
the vector space of real polynomials of degree at most 2. Show that 
A= (py, Pz, P3} is a basis for Р. 

Solution 


In order to do this, we have to show that (i) A is linearly indepen- 
dent and (ii) that <A> = P}. 


(i) The standard method of proving a set of vectors linearly 
independent is to show that the only linear relation between 
the given vectors is the trivial relation with all the scalars 
Zero. 


Let the linear relation be 

ap, + bp; + cp; = 0 (the zero polynomial) 
where a, b, c are real numbers. Then 

a(x? + 1) + b(x + 1) + cx? +x + 1) 


= (а + e)? + (b + с)х + (a+b + c) 
=0 


This implies that a + c = 0, 
b+c=0 

anda+b+c=0., 

The only solution to these three equations is 
a=b=c=0; 


so that A is linearly independent. 
(ii) By the definition of P, we have 


Ру = (1, x, x”), 


and using the method of the Replacement Theorem we сап 
replace fl, x, x?) by the linearly independent set (51 P2; Pa} 
to obtain P, = <p;, P2, P3) = <A>. 
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1.3.2 Dimension 


This sub-section deals with Theorems 3.1 to 3.6 on pages N15-17. 


Let us suppose that we have a vector space V and two bases, A and B, 
for it; then can we find any connection between A and В? In the last 
example we saw that P, has two bases, (1, x, x^) and {х2 +l, x+], 
xi-x 1}, and we notice that both bases have the same number of 
elements. Again {(1, 0), (0, 1)} and ((1, 1), (3, —1)} are bases for R?, as 
we saw in sub-section 1.2.2, and both bases have the same number of 
elements. This is no accident, as the next theorem, Theorem 3.1, shows. 
The proof of Theorem 3.1 follows immediately from Theorem 2.7 and it 
will help to clarify Theorem 3.1 if, after reading the statement of the 
theorem, you try to write down your own proof of Theorem 3.1. 


READ from Theorem 3.1 on page N15 as far as (but not including) Theorem 
3.2 on page N16. 


Notes 


(i) line —7, page NIS *... the dimension ... is well defined." What is meant 
here is that we have defined the word dimension in terms of the number of 
elements in a basis for the vector space, and if we did not have a theorem like 
3.1, then we could not talk about the dimension of a vector space, but only 
about a dimension relative to a given basis. 


(ii) lines —6 to —3, page NIS These statements are just definitions of conven- 
ience, as you will see later. 

(iti) line —3, page N15 Many of the vector spaces whose elements are functions 
are infinite-dimensional and, as we shall see in later units, they are of very great 
interest indeed. It is worth while, in looking at any theorem about vector spaces, 
to see whether the theorem applies to arbitrary vector spaces. If it is restricted 
to the finite-dimensional case one should consider the reason why. An interesting 
case of this was Theorem'2.7, where the spanning set A has to be finite, otherwise 
the replacement process would go on for ever. 


Theorem 3.1 tells us a lot about bases for finite-dimensional vector spaces 
but it does not help us find a basis for any particular space. However, 
there are ways of finding bases, at least for finite-dimensional spaces, 
and many of them rely on the replacement technique. We list some of them 
below and indicate briefly how one might use the Replacement Theorem 
to prove that they work. Remember that a basis has two essential 
properties: 


() itspans the vector space; 
(i) its vectors are linearly independent. 


The first two theorems below show that if we know the vector space is 
n-dimensional and we have a set of n elements, then we can assert that these 
n elements are a basis if we have either (i) or (ii): we don’t need both. 


Theorem A set B of n linearly independent vectors in an n-dimensional 
vector space V forms a basis for V. 


To prove this theorem we want to show that B spans V. The proof follows 
from observing that V is n-dimensional and so must have a basis A con- 
taining n vectors. Now a basis spans V, so <A> = V; if we use the replace- 
ment technique to replace the elements of A by those in B, the process will 
end with all the vectors in 4 having been replaced by those in B. That is, 
B also spans V and hence is a basis for V. 


The converse of our theorem is also true; any basis for V is a set of n 
linearly independent vectors. Our theorem and its converse together form 
Theorem 3.3 on page NI6. 


In a similar way we can show: 
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Theorem A set A of n vectors which spans an n-dimensional vector space V 
is also a basis for V. 


To prove this theorem we want to show that 4 is a linearly independent 
set. We use a proof by contradiction: suppose the vectors in A are linearly 
dependent; then we can discard at least one to get a set А, of n — 1 or 
fewer linearly independent vectors which spans V (this is the result stated 
as Theorem 2.5 in N). But this would mean that V is of dimension n — 1 
or less, which contradicts the definition of V. Hence our supposition is 
false: the set A is not linearly dependent and the theorem is proved. 


The converse of this theorem is also true: any basis for V is a set of n 
vectors which spans V. Our theorem and its converse together form 
Theorem 3.4 on page N16. 


Finally, here is another theorem which is an immediate consequence of 
the replacement process and the fact that a finite-dimensional vector 
space has a finite spanning set. 


Theorem 3.6 (page N17) In a finite-dimensional vector space V any linearly 
independent set of vectors B can be extended to a basis. 


The idea behind this proof of this is easy. Take any basis A for V and use 
the replacement process of Theorem 2.7 to insert all the elements of B 
in A, getting rid of an equal number of elements of A from the set as we 
proceed. 


The following example illustrates the use of this theorem in finding a basis. 


Example 


The set {8 = (1, 3)} is linearly independent іп R?; so the theorem tells us 
it can be extended to give a basis. Although, in this simple case, it is 
very easy to complete the basis (any vector which is not a scalar multiple 
of (1, 3) will do), we apply the theory explicitly, to illustrate the method 
for less obvious cases. 


Іо; = (1, 0) and а, = (0, 1), 
(o4, à) spans R?; 
therefore (fl, «у, аз} spans R?. 


Having added fj, we now wish to eliminate either c, or a to complete the 
replacement process. 


Since f e R? and <a,, a,» = R?, 

В is a linear combination of o, and a: 
В = о; + 3a, 

Непсе 
a, = В — 3a. 


So we can replace o, by 3 to obtain the set (B, 3), which also spans R?, 
Since R? is of dimension 2, any set of 2 elements which spans R? 


; ; , must be 
a basis. So (fj, а) is a basis containing £. 


Exercise 
l. Construct a basis for the real vector space P, which includes the 


vector p = x? — 3, 


2. Page N19, Exercise 2. (The vector space is R?, which is 3-dimensional.) 
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Solution 


1: 


We use the replacement Process. (1, x, x?) is a basis for P, 
and so spans P. * 


The set (p, 1, x, x?)is linearly dependent; in fact 
--3:041:x? 
so 
1 = —}p + 4x2, 


Thus the set {p, x, x?) also spans Ру, and since P, has dimen- 
Sion 3 this set is a basis for Р; (Theorem 3.4). The replacement 
process does not, of course, necessarily give a unique result. 
For instance, in this case, (p, 1, x) is also a basis; the replace- 
ment process allows us to replace either 1 or x?, but not x. 


To show that 


(1, 0, 0) e «(1, 1, 0), (1, 0, 1), (0, 1, D» 
we obtain 

(1, 0, 0) = 4(1, 1,0) + 4(1, 0, 1) — 4(0, 1, 1). 
Similarly : 
(0, 1, 0) = $1, 1, 0) — 41, 0, 1) + 4(0, 1, 1) 

(0, 0, 1) = —4(1, 1,0) + 41, 0, 1) + X(0, 1, 1) 
Now any vector in R? is of the form 

(a, b, c) = a(l, 0, 0) + B00, 1, 0) + c(0, 0, 1) 


which by the above three relations is a linear combination of 
(1, 1,0), (1,0, 1) and (0, 1, 1). Thus, we have shown that 
{(1, 1, 0), (1, 0, 1), (0, 1, 1)) spans R°. Since R? is 3-dimensional, 
it follows by Theorem 3.4 that this set is a basis. 
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1.3.3 Coordinates 


This sub-section deals with the remainder of Section 3 on pages N17-19. 


In this sub-section, we see how we can use a basis for a finite-dimensional 
vector space V to give a unique numerical representation of every vector 
in V, by means of coordinates, which are analogous to the Cartesian co- 
ordinates used in analytic geometry. This will make it possible to give a 
complete description of a finite-dimensional vector space over a field F. 
To see how coordinates are introduced, let us consider the real vector 
space P, of all polynomials of degree at most 2. We have seen that the 
set (1, x, x?) forms a basis for Ру and that any polynomial p = a + bx + 
cx? is expressed as a linear combination of these basis vectors: 


p=al+bx + сх? 


We noted at the beginning of Section 3 that this representation for р as 
a linear combination of 1, x, x? is unique. That is, given the polynomial 
p, the coefficients a, b, c are uniquely determined. We can use this unique- 
ness of representation to introduce coordinates into Рз. Given the basis 
(1, x, х2}, any polynomial p = a+ bx + сх? is determined uniquely by 
the coefficients a, b, c; so in order to specify p we only need to specify 
the ordered triple (a, b, c). The elements of this triple are called the 
coordinates of p with respect to the basis (1, x, x?). The last part of this 
last sentence emphasizes that the coordinates on their own are not enough. 
The same coordinates with a different basis give a different vector; for 
example, if the basis were (1, x, x? — x) instead of (1, x, x?), then the 
polynomial specified by the ordered triple of numbers (1, 2, 3) would be 


1 + 2x + 3(x? — x) = 1 — x + 3x? 
instead of 
1 + 2x + 3х2. 


READ from page N17 line —11, to the end of the section on page N19 
(omitting the exercises). 

Notes 

line 13, page N18 In the Foundation Course we paid considerable attention to 
the idea of a morphism, by which we mean, roughly, a mapping that preserves 
some mathematical structure. An isomorphism is a morphism with an inverse 
which is also a morphism, and the domain and codomain of an isomorphism 


are said to be isomorphic. Here we are concerned with the structure described 
by the vector space axioms. 


Exercise 
Find the coordinates of 
р= х? – 3х +2 


with respect to the basis (x — 1, х + 1, х2}. 


Solution 


If (a, b, c) are the coordinates of p with respect to the 
then 


given basis, 
р = сх? + b(x +1) + а(х — 1) 
= сх? + (b +а)х + (b — a)l 
But 


p-x-3x42 
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an (^, x, 1} is also a basis. Therefore the linear combination of 
x", x and 1 which gives p is unique. So 


с=1, b+a=-3, b-a=2 
ie. the coordinates of р are (~$, —4, 1) with respect to 
{x —1,x + 1, x?}. 


1.3.4 Summary of Section 1.3 


In this section we defined the terms 


basis (page N15) 
dimension (page N15) 
coordinates (page N17) 


We discussed the following theorems 


1. 


(3.1, page N15) - 

If a vector space has one basis with a finite number of elements, then 
all other bases are finite and have the same number of elements. 

(3.3, page N16) 

A set of n vectors in an n-dimensional vector space V is a basis if 
and only if it is linearly independent. 

(3.4, page N16) 

A. set of n vectors in an n-dimensional vector space V is a basis if 
and only if it spans Y. 

(3.6, page N17) 

Jn a finite-dimensional vector space any linearly independent set of 
vectors can be extended to a basis. 
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14 SUBSPACES 
1.4.0 Introduction 


A vector space V, with its field F, is an example of a mathematical 
structure; that is, a set with certain algebraic operations defined on the 
set, Fields and groups аге two other examples of mathematical structures 


which you have already met. 


Whenever we want to find out more about a structure, there are two things 
we can do. One is to look at the structure as a whole, by comparing it with 
other similar structures: the mathematical instrument we use to do this is 
the morphism. We have already used this instrument to a considerable 
degree in the Foundation Course, and we shall be using it again in later 
units of this course. Also the idea of coordinates as we have just seen, uses 
the morphism idea in the form of an isomorphism. The other way of 
finding out more about a structure, which is itself often interlinked with 
the first, is to take the structure to pieces as it were, by looking for simpler 
versions of the same structure within itself: that is, we look for subsets 
of the original set which have the same structure. In the case of a vector 
space, this means that we look for subsets of the vector space which are 
themselves vector spaces. Geometrically, this may be visualized as studying 
three-dimensional space by looking at some of the planes and straight 
lines in it; since every vector space must have a zero element, we are 
restricted when studying such subspaces to planes and lines through the 
origin. 


We shall not take this study very far at this stage: if you are interested and 
have the time, you may like to read more of Section 4 of N than we indicate 
in the following. We shall merely define a subspace and discuss criteria 
for a subset of a vector space to be a subspace. 
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1.44 Definition of a Subspace 


READ Section 4 starting 


on page N20 as far as (but not including) Theorem 
4.1 on page N21. 


Notes 


(i) line —6, page N20 The Notation p(xi), where p is а polynomial and x, is a 
number, means the image of X under the corresponding polynomial function. 
For example, if p = 2x +3 then P(x1) = 2x, +3, and p(10) = 23. 


(ii) line —3, page N20 If р, pz are polynomials such that p,(xi) = р(х) —0, 
then 


(р + P2)(%1) = р(х) + pax) 
=0+0 
=0 


so that p, + pz also vanishes at xı; and the same is true of x2, хз, etc. Similarly 
if a is a real number, then (ap,)(x) = a(pi(x)) = a0 =0. 


р(х) 


(x,,0) (x2,0) 


ртр, 
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Gii) line —2, page N20 If m n, then we have polynomials of degree п<т 
with m zeros. (N.B. А polynomial р has a zero at xif p(x) — 0.) There is a general 
theorem in algebra which states that the only such polynomial is the zero 
polynomial. (In fact, m = л would give the same result, since P, consists of all 
polynomials of degree less than or equal to л — 1.) Thus the answer to N's 
question is that we still get a subspace, but it is trivial, i.e. it contains the 
zero polynominal only. 


One can visualize the theorem for P;. If we suppose that a polynomial p of 
degree 1 has two zeros, x, and x;, then p(x.) = р(х) = 0. But geometrically 
p is represented by a straight line, which must pass through (x1, 0) and (хг, 0). 
It is therefore the x-axis, i.e. p is the zero polynomial. 


ap(x) 


There are two important points to note in this passage. The first is that 
all you have to do to check that a subset W of a vector space Vis a subspace 
is to show 


(a) Wis non-empty; that is, there is at least one vector in W (which may 
just be the zero vector); 

(b) ifa, a; є Wand a, be F, then aa, + ba, є W; i.e. W is closed under 
the taking of linear combinations. 


We shall use these two properties over and over again in proving theorems 
and statements about subspaces. The other point is that we have an 
important property of a spanning set, one which we did not discuss in 
Section 1.2, namely that, if A is a subset, (A) is a subspace. 


Exercises 


l. Page N24, Exercise 1. 
2. Page N25, Exercise 11. 
3. Answer N's “Why?” on line 7, page N21. 


Solutions 


l. The answers to this exercise are given in N. We add notes 
on the first and last part. 


(a) This is a subspace. Call the subset X; we have to verify 
two things. First X is non-empty; the zero polynomial is 
in X since it has the value 0 everywhere, in particular at 
1. That is, X is non-empty. Secondly, X is closed under 


the taking of linear combinations. We consider the poly- 
nomial 


9 = ap, + bp; 


where a and b are real numbers, and p, and p, are in X. 
To see if g is in X, we calculate q(1). 


4(1) = (ар, + bp;)(1) 
= (ар,)(1) + 72109) 
= a(p.(1)) + b(p4(1)) 
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=a-0+b-0 


=0+0 
=0. 


since we assumed that 
Pi, P2 EX 


That is, (1) = O and q isin X. 


Hence we have shown that X is a subspace of P. 
(е) The subset here is not a subspace, since, for example, 


(x? + 2x 1) + (-x! +.x42) = 3х +1 


and the latter is not of even 


There are two parts to the answer. We have to show that 


(i) if W, and W, are subspaces such that one is a subspace 


degree. 


of the other, then W, U W, is a subspace 


(ii) if W, and W, are subspaces such that neither one is a sub- 
space of the other, then W, U МУ, is not a subspace. 


N's answer concerns (ii) only. 


(i) is easily established. If, for example, W, c W;, then 
W, u W, = W,, and hence W, u W, is a subspace. 


(i) The following diagram may help you to understand 
N's answer, which we paraphrase below. 


w 
Consider 
a, € W, — №; 
and 
о Є №, —W, 
Then, since o, є W, and a, € W,, 
а + 03 Wi 
for otherwise, x; would be in W,. 
Similarly 
a, +a € М. 
Since 
a, + a) ¢ W, 
and 
а +a € Wo, 


a +a, ¢ W, U М. 


Wo 


Thus W, u W, is not a subspace, since it is not closed. 
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As an example, consider the subspaces of P given in (a) and 
(b) of Exercise 1. 


a, = x — 1 belongs to the first subspace 
аз = х? + 2x belongs to the second subspace 


buta, + @ = x? + 3x — 1 belongs to neither subspace and so 
does not belong to their union. 


3. The subset of К" of all z-tuples of rational numbers, ©", 
is not a subspace over R since it is not closed under scalar 
multiplication. For example 


gated DEC 
but 
пят п 
а (650503) 
1.4.2 Summary of Section 1.4 


In this section we defined the term 
subspace (page N20) 


We introduced a criterion for deciding if a subset of a vector space is a 
subspace: 


a subset W of a vector space V is a subspace, if 
(a) Wis non-empty 
and if 


(b) о, о, є Wand a, be F, then aa, + ba, є W; i.e. W is closed 
under the taking of linear combinations. 


1.5 SUMMARY OF THE UNIT 
Definitions 


i terms defined in this unit and references to their definitions are given 
elow. 


A field is any mathematical structure satisfying the axioms Fl to F11 
on page N6-7. 


A vector space (over some given field F) is any mathematical structure 
satisfying the axiams Al to 45 and B1 to B5 on pages N7-8. In particular, 


the set is closed under the operations of addition, and multiplication by 
any scalar (i.e. element of F). 


You are not expected to memorize these lists of. axioms, but you should be 
able to use them to check whether a given structure is, or is not, a vector 
Space. 


Other terms defined are 


linear combination (page N11) 
linear relation (page N11) 
linearly dependent (page N11) 
linearly independent (page N11) 
span (page N12) 
basis (page N15) 
dimension (page N15) 
coordinates (page N17) 
subspace (page N20) 
Theorems 


We list the important theorems discussed in this unit. Only 2- and 3-star 
theorems which are essential to this and later units have been included in 
this list. References to the statement of the theorems in N are also given. 


1. (2.1, page N12) 
If о is linearly dependent on {f;} and each £; is linearly dependent on 
{y,} then а is linearly dependent on (y). 

2. (2.5, page N13) 
If а, € Ais dependent on the other vectors in A then 


<А) = XA — (n? 
3. (2.7, page N13) 


The Replacement Theorem. If a finite set А = (01, &2, ..., a,) spans 
V then every linearly independent subset of V contains at most m 
elements. 

4. (3.1, page NIS) 
If a vector space has one basis with a finite number of elements, then 
all other bases are finite and have the same number of elements. 

5. (3.3, page N16) | jl 
A set of n vectors in an n-dimensional vector space V is a basis if and 
only if it is linearly independent. 

6. (3.4, page N16) | Ж 
A set of л vectors in an n-dimensional vector space V is а basis if and 
only if it spans V. 


7. (3.6, page N17) | | 
In a finite-dimensional vector space any linearly independent set of 


vectors can be extended to a basis. 


Techniques 
1. The replacement process, which tells us how to include a set of linearly 
independent vectors in a spanning set. 
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2. А criterion to decide if a subset is a subspace. 
A subset W of a vector space V is a subspace, if 
(a) Wis non-empty 
and if 
(b) «,а,є W and a, be F, then ag, + Базе W; i.e. W is closed 
under the taking of linear combinations. 
Notation 
<A) denotes the set spanned by the set of vectors A. 


Examples 


We introduced three important examples of vector spaces; all were first 
introduced in sub-section 1.1.1. 


Е" The space of n-tuples of real numbers 
(a1, a2, ..., a, a; € К. 


С[а, b] The space of all real functions continuous on the interval (а, 5]. 
P The real vector space of polynomials with real coefficients. 
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1.6 SELF-ASSESSMENT 


Self-assessment Test 


This Self-assessment Test is designed to help you test quickly your under- 
standing of the unit. It can also be used, together with the summary of the 
unit, for revision. The answers to these questions will be found on the next 


non-facing page. We suggest you complete the whole test before looking 
at the answers. 


In the following questions choose the most appropriate option from those 
given to complete the sentence. 


І. The set of vectors ((1, 1), (2, 2), (е, e), (x, л)} is linearly 
— à nk 

A independent 

B dependent 


2. The set of vectors {(1, 1), (3, — 1), (1, —1)) spans a/an 3 
dimensional vector space. 
A 1 
B 2 
сз 
D infinite 


3. The set of vectors W = {(0, a, b): a, be R) forms a 
GM PE NENNEN, 
A basis for 
B spanning set for 
C subspace of 


4. The polynomials 1 + x, 1 — x forma —__________ P;. 


A subspace of 
B basis for 
C subset of 


Classify each of the following statements as either true or false. 


5. In any n-dimensional vector space, any subset of n vectors spans V. C 
6. Any linearly independent subset of V can be extended to a basis for V. 7~ 
7. Any set which spans V is a basis for V. 5 


The following questions require some calculation. 


8. The set {1 +x, 1 — x, 1 x  x?, x — x?) is a spanning set for Рз. 
Use the Replacement Theorem to include (1 — x^, | +x} in a span- 
ning set for Рз. 

9. Specify the set spanned by {(1, 1, 0), (1, 0, 1)) in КЗ. 
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Solutions to Self-assessment Test 


$ 
2. 


Anon 


B, dependent. 
B, 2. 


C, subspace. 
B, basis. 


False. 
True. 
False. 


Each vector is a linear combination of (1, 1). 

The vectors form a subset of R? so that C and D are 
obviously wrong answers. On the other hand (1,1) 
and (1, —1) are linearly independent so that €, 1), 
(1, —1)> = R^; so A is also wrong. 

W is-an infinite subset of R?, a space of dimension 
3; so A is wrong, any basis for R? must have just 3 
elements. W does not span R? because (1, 0, 0) # <W). 
B is the most appropriate answer, while C is also 
true. (1 + x, 1 — x} is not a subspace; it does not, for 
example, contain the zero vector. 

The n vectors may be linearly dependent. 

See sub-section 1.3.2, Theorem 3.6. 

See sub-section 1.3.2, Theorem 3.4. Also question 2 
above. 


To make the use of the Replacement Theorem more obvious, let 


a -lexl w-1-x  a«-lÓc-x4x, 


g,-x-x, 


B-1-x, В =1+ х. 


We first note that f, f; are linearly independent so we can use the 
Replacement Theorem. 


If we add fj, to (o, a2, оз, о), which а can be omitted? We write f, 
as a linear combination of the as. 


B-1-x 
=l-x+x-x? 
=O, + a4. 

So 
Gy = — tty + By 


and we replace a, by ,. 


P, is spanned by (f, a, «3, o). 


Now write f; in terms of this spanning set. 
B2=1+x 
=1+x+x -x 
=l1+x +x- х? 
=Q + a4. 


So 


a = Br = а, 


and we replace a, by ГА 5 


This gives {B,, 2, a5, a4) as a spanning set for P}. 
The set spanned by {(1, 1, 0), (1, 0, 1)} is the set of all vectors of the 


form 


a(l, 1, 0) + b(1, 0, 1) a,beR 


{(a + b, a, b): a, be R}. 


If we think of the geometric representation of this set, th: 
» the 
belongs to the set if ave 


х=у+ 


and this is a plane through the origin. 
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D. L. Kreider, R. G. Kuller, D. R. Ostberg and F. W. Perkins, An Intro- 
duction to Linear Analysis (Addison-Wesley, 1966). 

E. D. Nering, Linear Algebra and Matrix Theory (John Wiley, 1970). 

It is essential to have these books; the course is based on them and will not 
make sense without them. 


Conventions 


Before working through this correspondence text make sure you have read 
A Guide to the Linear Mathematics Course. Of the typographical conven- 
tions given in the Guide the following are the most important. 


The set books are referred to as: 


K for An Introduction to Linear Analysis 
N for Linear Algebra and Matrix Theory 


All starred items in the summaries are examinable. 


References to the Open University Mathematics Foundation Course Units 
(The Open University Press, 1971) take the form Unit M100 3, Operations 
and Morphisms. 


2.0 INTRODUCTION 


You have met linear transformations previously if you took the Foundation 
Course, M100. They are functions that map one vector space to another; 
in other words, they are vector space morphisms (or homomorphisms, as 
they are called in N). One example of a linear transformation, which we 
saw in Unit 1, Vector Spaces, is the mapping from any real vector space V 
of dimension л to the space А", in which each vector in V is mapped to its 
coordinates with respect to some chosen basis in V. 


In geometry, the linear transformations* include rotations about the origin, 
reflections in a line or plane through the origin, and dilations (magnifi- 
cations), or in general, any mapping that maps parallel straight lines to 
parallel straight lines and the origin to the origin. We shall meet many other 
examples of linear transformations during the course. 


We study transformations partly for their own interest, partly to help us 
understand the structure of vector spaces (by mapping them to other spaces, 
Such as R", or a geometrical space, whose structure is easier to understand), 
and partly because they crop up so often when we try to solve problems 
using mathematics. You will have met many such problems already; for 
example, a system of linear simultaneous algebraic equations such as 


2x —-3y 23 
x+y =5 


can be considered as arising from a linear transformation of R? to itself. 

We discussed this in some detail in Units M100 23 and 26, Linear Algebra 

П and III. As further examples consider the following. (You are not ex- 

pected to understand them fully; their purpose is to show you that the 

subject does have applications.) 

(1) Thereinforced concrete beam in the building below is subjected to the 
forces indicated. What would be the deformations if the forces were 
changed? 


(2) Two batteries of voltages V, and V;, the second with a large resis- 
tance R;, drive a circuit element of arbitrary nature, except that it has 
resistance R}. The problem is to determine the currents in the circuit. 


* Some authors of geometry texts use a different definition from the one we shall use in this 
course. So, if you venture into geometry, check definitions first. 


(3) A periodic driving force is applied to a mechanical system that can 
vibrate. How does it move? (We discussed some aspects of this prob- 
lem in Unit М100 31, Differential Equations П.) 

(4) Suppose that a survey revealed that 39/ of country-dwellers move into 
town each year and 1 % of town-dwellers move into the country each 
year. At present, 50% of the population live in towns. What is the 
future population distribution going to be? 


How do we build mathematical models of these situations? At this stage, 
we have to decide what are the basic features of the system we are con- 
sidering. In fact, all the above examples have been chosen to illustrate the 
same basic features: one aspect or state of the system is related to another 
aspect or state; i.e. there is a transformation between the characteristics of 
one state and those of the other. Furthermore the relation can be shown to 
be linear. The following table shows in the second and third columns the 
related states for each example. 


(1) Building Stresses Deformations 
(2) Circuit Voltages Currents 
(3) Oscillating Driving force Motion 
system 
(4) Society Population Population 
Distribution Distribution in the 
now future. 


If you appreciate that each of these problems involves a relationship be- 
tween the characteristics of one state and those of another and that this 
relationship is independent of the particular way we choose to represent 
these states, then you will see that it makes sense in the mathematics to 
consider linear transformations in the abstract without regard to any 
specific numerical representation. 


In Section 2.1, we find numbers that characterize a linear transformation in 
the same way that the dimension characterizes a vector space; these numbers 
are the dimensions of the two vector spaces concerned (the domain and 
image set), and a number called the nullity of the transformation. 


Tn Section 2.2, we look at the representation of a linear transformation by 
scalars (the matrix representation), analogous to the representation of a 
vector by coordinates. 


Consider the inverse problem to that of Example 3 above. If we know how 
the mechanical system moves, can we determine the periodic driving force? 
Section 2.3 looks at the special matrix properties involved in such inverse 
problems. 


The material in this unit is essential to all the subsequent units. The 
difficulty and the amount of time that it will take you will depend on your 
recall and grasp of the linear algebra units of the Foundation Course, as 
well as the units on mappings and morphisms. If you find this unit and 
Unit 1 taking longer than you would like, it is probably because they con- 
tain a large amount of revision material. 


2.1 LINEAR TRANSFORMATIONS 


2.1.1 The Definition of a Linear Transformation 


Chapter II, Section 1 of Nering, 


: which starts on pa i 
transformation, and gives name P eon ake 


à 5 to various special types of linear trans- 
formation. The only definition that you have not met already in the Found- 


ation i i i if cisali 
Course is that of inverse image: if c is a linear transformation from a 


vect 
2 ds U toa vector Space V, and fi = o(a) is the image of a vector 
«€ V, then a is called an inverse image of 3 under с 


inverse 7° 


Of course, there may well be more than one inverse image of f! under c. The 
collection of all the inverse images of fj, which is a set, is called the com- 
plete inverse image of В. We know it from the Foundation Course as the 
image of 3 under the reverse mapping of c. 


READ Chapter II from the beginning on page N26 to tlie bottom of page N27 
(excluding last two lines). 


Notes 


(i) line 4, page N26 In Foundation Course language we could phrase this “A 
linear transformation is a function whose domain is a vector space U and whose 
codomain is the same or another vector space V, which is a morphism with res- 
pect to the taking of linear combinations." 

(ii) line —6, page N26 “We identify U and V" means “we treat U and V as 
identical ", not “we establish the identity of U and V". 

(iii) Jines 1-7, page N27 Hermite normal form is the subject of Unit 3. 

(iv) line 15, page N27 “Single-valued mapping" is another way of saying 
“function”. 

(v) line 20, page N27 If В is the image of æ, then æ is an inverse image of B, and the 
set of all inverse images of В is the complete inverse image, с^! (В). 


In the Foundation Course we described inverse images in terms of the reverse 
mapping, whose images are the inverse images for the original mapping. 

In the Foundation Course you also met the kernel of the transformation о, which 
is the complete inverse image of the zero vector in V. For example, if U is a suit- 
able set of functions and c is the differentiation function (or operator), then the 
function sin is an inverse image of the function cos, and the complete inverse 
image of cos is the set of all functions of the form 


sin + constant function 


(vi) line —6, page N27 In the Foundation Course we used the word morphism 
in the way “homomorphism” is used here. In particular, this means that an 
isomorphism is a special case of a homomorphism. 


Exercises 


]. Exercise 1 on page N35. 
Define a: А ———9 А? by a(x) = (x, 2x). Prove that c is a linear 
transformation of R into R?. 

3. Define c: А ——9 А by а(х) =x’. Prove that c is not a linear 
transformation. 

4. Define с: R? ——9 А? by о((х, y)) = (2x, y?). Prove that ø is not a 
linear transformation. 


Solutions 


l. To show that the given c is a linear transformation we must 
show that it satisfies the definition on page N27. Since R? is 
à real vector space, the field called F in this definition is R. с, in 
this case, is clearly a function; so we are left to check that it 
satisfies Equation (1.1) on page N27. To calculate the left-hand 
side of the equation, we must specify с and 3 as vectors in R?. 


Let 

« = Qu V2), В = (Z1, 22) 
so that 

aa + bB = (ay, + bz,, ау, + bz;) 
(by rule (1.2) on page N9). 


Then the left-hand side of the equation in the definition is, by 
the definition of c, 


o(ax + bf) = (ay; + bz, ay, + bzy) 
The right-hand side is 
ас(о) + bo(B) = а(уз, Yı) + b(Z2, 21) 
= (ayz + bz2, ay, + bz) 


and since this equals the left-hand side for all a, b, y,, уу, 21, 
25, the definition is satisfied. 


2. Equation (1.1) on page N27 can be established as follows: 


с(ах + by) = (ax + by, 2(ax + by)) 
= (ax + by, 2ax + 2by) 
= (ax, 2ax) + (by, 2by) 
= a(x, 2x) + Му, 2y) 
= aa(x) + bo(y). 


3. That Equation (1.1) does not hold for all a and b can be seen 
in the following. If b = 0, and a is not 1 or 0, then 


alax + by) = o(ax) 
= atx? 
= а?о(х) 
# ас(х). 
4. Ifb=0, 


e(a(x, у) + b(w, z)) = a(a(x, у)) 
= о((ах, ау)) 
= (2ах, а?у?) 
= a(2x, ау?). 
and ao((x, уу) + bo((w, z)) = ae((x, у)) 
= a(2x, у?). 
Thus, unless a = 0 or 1, Equation (1.1) does not hold. 


2.1.2 Jsomorphisms 


One reason for studying morphisms is to compare different mathematical 
structures. In general, the structure in the image set of a morphism may be 
simpler than the one it came from in the domain: as an extreme example, 
there is a linear transformation that maps every element of the domain to 
the vector space consisting of the zero element only; thus it completely 
obliterates the original structure. We might call this a “ forgetful” mapping! 
The other extreme is a mapping with a perfect memory. A morphism that 
does transfer the domain structure in full detail to the codomain is called 
an isomorphism, and can be characterized by the fact that it has an inverse, 
which is also a morphism, by which we can return from the codomain to 
the domain and recover the original structure in full detail. The next reading 
passage begins by considering the conditions under which a morphism has 
an inverse function (it must be one-one and onto) and then shows (Theorem 
1.1) that this inverse function is an isomorphism. You should know the 
statement of this theorem and be able to follow the proof, but you are not 
expected to be able to reproduce the proof. 


READ from the last two lines on page N27 to the paragraph ending with the 
words “or a one-element set” near the foot of page N28. 


Notes 


(i) line —1, page N27 Ignore the term “monomorphism”: the term one-to-one 

(or one-one) is enough for this course. 

(ii) line 3, page N28 In the Foundation Course we used the term image set of о, 

rather than “image of о” for the set of all images under ø. 

(iii) line 4, page N28 In words, onto means that each element of Y has at least 

one inverse image. Ignore the term “epimorphism”: the term onto is sufficient for 

this course. А 

(iv) lines 19-21, page N28 For ап epimorphism, read onto and for a monomor- 

phism, read one-to-one. By notes (i) and (iii) above, if с is both one-to-one and 

onto, then each element of V has no more ang no less than one inverse image. 
ine 23, page N28 The mapping c^! is a function. 

M poe line of Theorem 1.1, page N28 In this theorem, o stands for the 

isomorphism itself. Notice the strategy of proof: it is the same as that of Solution 

1 on page 8. That is, we prove that о-! satisfies Equation (1.1) on page N27. 


Example 
Show that с: А ———3 R, a(x) = 2x is an isomorphism. Find a. 


Solution 
o(ax + by) = 2(ax + by) = 2ax + 2by 
= aa(x) + bo(y). 


Linearity 


One-one Suppose x and x’ are two different real numbers. 
Then a(x) = 2x 

and о(х') = 2x’ 

ie. a(x) # a(x’). 

Thus c is one-one, by the definition at the foot of page N27. 


Onto As x runs through all of R, so does 2x; i.e. given any ye К, 
there is an element 4y, such that o(4y) = y. Thus c is an isomor- 
phism since it is one-one and onto. 


Inverse Clearly, c^! : R ——> R, o^ (x) = іх. 


While it is possible to do the above mentally, there is a definite 
value in pedantically setting everything out formally until one is 
familiar with the process. 


Exercises 


1. 


Show that с: R? ——> R?, o((x,, x2)) = (х, 2x,) is not an isomor- 
phism. 


2. Show that o((x,, x2)) = (2x,, 2x2) defines an isomorphism from R? to 
R?. Find o^! and verify that it satisfies the definition of an isomor- 
phism. 

Solutions 


10 


І. Clearly, c is a linear transformation, but that is not enough. 
In fact, let x2, х5 be two distinct real numbers. Then 
a(x, x2)) = (x1, 2x4) 
and o((x;, x3)) = (х1, 2х1). 
Thus, c is many-one. This is sufficient to show that ø is not 
an isomorphism. But you may notice that it is also not 
“onto” R?, The figure shows that the image cet is the line 
whose equation is x; = 2x, and not the whole plane. 


х2 


c(R?) 


2. To satisfy the definition on page N28, we show that a is a 
homomorphism and is one-one and onto. It isa homomor- 
phism (linear transformation) since 


(a(x), x2) + 50у, ¥2)) = o((ax, + буу, ax; + by2)) 
= Qax, + 2by,, 2ax + 2by,) 


and ao((x,, х)) + bo((y,, y?) = a(2x,, 2x3) + b(2y,, 2у›) 


= (2ax, + 2by,, 2ax; + 2by;). 
‘One and onto because the equation 


б((х\, х›)) = (уь рә), 


has exactly one solution, (x i 
exact » (Xis хә), for each (уу, уз). This 
solution is (x,, х) = (355, 492) and so = 


971: y) —— Gy, ЗУ»). 


The verification that c^ ' is an isomorphism is the same as for 
с, but with $ replacing 2 everywhere. 


It is one-i 


2.1.3 Examples of Linear Transformations 


REA D the last paragraph on page N28 and the first two paragraphs on page N29 
finishing at the words “ will denote the identity transformation on U”. 


Notes 
(i) line —1, page N28 “ The indefinite integral " means the image under the one- 
many mapping : 

f+ (all primitive functions off) 


which we denoted by Zin Unit M100 13, Integration 11. 


(ii) line 1, page N29 The exercise for this section will be to verify that о is onto, 
etc. 


(iii) line 13, page N29 The second exercise in the previous section dealt with a 
scalar transformation o : (x,, х) ———» (2x1, 2x2). 


Exercises 


Verify the statements about c and т in the first complete sentence on page 
N29. 


Solution 


The mapping c is the differentiation mapping for polynomials. It 
is onto P, since, given any polynomial 


п 
a=) ах! 
io 
there is always another polynomial 
5o di xit 


such that 


0(В) = a. 
In fact В = т(а). B is only one of the polynomials whose image 
under c is æ. g is not one-to-one since two different polynomials 
can have the same derivative (if they differ by a constant). 
The mapping t maps a polynomial to a particular one of its indef- 
inite integrals (primitives). It is one-to-one because two different 
polynomials (or functions) cannot have the same indefinite in- 
tegral: if the image 

S Ai itt 

0+1 
is known, then all the coefficients, ao, 4, 42, 43, +--> а, in the 
original polynomial 


и $ 
Y ax 
i=0 
are known. 


т is not onto, because only the polynomials having zero as their 
constant terms are images under т. 


п 


2.1.4 The Representation Isomorphisms 


We have already mentioned, in Unit 1, Vector Spaces, the fact that any 
vector space of dimension л over a field F is isomorphic to F". It is an easy 
step from here to prove that any two vector spaces of the same finite 
dimension z over the same field are isomorphic. 


Thus if {«,,...,,} is a basis for one of the spaces, U say, and ø is the 
mapping from U to F" defined by 


0:0,0, +*+ au M9 (a), ..., an) 


then g is an isomorphism (as shown at the top of page N18). If т is the 
corresponding isomorphism taking the other space V to F^, then by per- 
forming first c and then т^! we obtain a mapping from U to V which is also 
an isomorphism. 


The next reading passage discusses this important isomorphism briefly. 


READ (а) page N29, the one paragraph beginning “ When a basis ...”. 
(b) page N48 the one paragraph beginning “ Let U and V be vector 
spaces. ..". 


Notes 


Line 9 of the third paragraph on page N29 It does not matter if you cannot see 
the point of the remarks about natural or canonical isomorphisms at this stage. 
Until we come to the unit on linear functionals, none of the isomorphisms we 
consider will be natural. The important thing is that the isomorphism from V to 
F" considered here depends on the basis used in V : use a different basis and you 
get a different isomorphism. 


i2 
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2.1.5 Тһе Combination of Linear Transformations 


Since linear transformations are functions, they can be combined in various 
ways, as discussed in Unit М100 1, Functions. 


READ from the last paragraph on N29 as far as (but not including) Theorem 
1.2 on page N31. 


Notes 


(i) line —8, Page N29 The addition of linear transformations gives a convenient 
notation for linear differential equations. For example, if U is a suitable set of 


functions, and D is the linear transformation of differentiation then we can define 
linear transformations such as 


2D +3: f — — 2Df + 3f=2f' - 3f (f eU) 
and write an equation such as 

2f' + 3f=e, 
where g is some given function, in a form such as 

(28 + 3)/= ғ. 


The advantage of this notation is that one can specify the linear transformation 
in a very concise way, without using any arrows or “dummy variables”. We 
shall use this notation in the units on differential equations. 

(ii) line 16, page N30 The Foundation Course notation would бет о с rather than 
те, and instead of iteration or multiplication, we would have used composition. 


The passage you have just read could be summarized as follows: 


1. The set of all linear transformations with domain U and codomain V, 
denoted in N by Hom (И, V), is itself a vector space. Here, Hom 
(И, V) stands for homomorphisms of U into V. 

2. Linear transformations can sometimes be “ multiplied " together by the 
rule for composition of mappings; but this type of multiplication can- 
not be defined between every pair of mappings. Even when it is defined, 
it is not generally commutative. Note that these “ multiplications” 
give Hom (U, U) more structure than that of a vector space, since this 
operation of “multiplication” is in addition to those required to 
specify a vector space; i.e. vector addition and scalar multiplication. 


Exercises 


Exercise 2 on page N35, taking the vector space in question to be R?. 
2. Prove that то, as defined on page N30, is a linear transformation. 

3. Exercise 6 on page N36. (To translate this exercise into Foundation 
Course notation, it is easiest to take y to be a function and to replace 


2 in the statement of the question by the derived function у.) Hint: 
Ix 


use the result of Exercise 2. 


Solutions 
1. (oy +05): (ху, x2) ——> (0, =x) + (х=) 
i.e. (0, + 03) : (ху. X3) ——> (x, + Xz — 31 — X3). 
суту: (ху, Ха) 9 eio 7 x3) 
Le. 0,03 : (Xp X3) ——3 (7X3. —Х|). 
830, : (Xp X3) 9 6303, — X1) 


i.e. 020, 1 (х1, X3) — (x2; ху). 


Note that 250, # 0,05; in fact 0105 = —030,. 


13 


2. For any a, beF and any g, Be U we have 
talag + bB) = x(ac(«) + bo(fl)) since ø is linear 
= ат(о(о)) + bt(o(f)) since т is linear 
= ато(о) + bto(B). 
Thus то is linear. . 
3. Dislinear since, for any two functions y and z in the domain 
of D, 
D(ay + bz) = aD(y) + bD(z) 


by the rules of differentiation. By the result of Solution 2, it 
follows that D? = DDisalso linear, and hence that D? = D? D 
is also linear, and so on up to D". Further, if 

P(D) =a, +a, D+: +a, D", 


then this is the sum of the transformations ao, a, D, ...,4,D", 
which are themselves linear, and hence p(D) itself is linear by 
the result proved at the bottom of page N29. 


2.1.6 Image Space and Kernel 


Two subspaces are very naturally associated with every linear transfor- 
mation. One of these subspaces is in the codomain, V, and is the image 
space denoted by Im(o), consisting of all vectors that are images under c. 
The other subspace is in the domain, U, and is our old friend from the 
Foundation Course, the kernel of c. Denoted in N by K(o), it is the same as 
o~'(0), the complete inverse image (as defined on page N27) of the zero 
element of V. 


We first establish that Im(c) and K(c) really are subspaces—that is, they 
are closed under the operation of taking any linear combination of two 
elements, and are not empty (see page N20). You have aready met the 
proofs that both of these sets are Subspaces in the Foundation Course. 
To revise the proof that Im(ø) is a subspace 


READ Theorem 1.2, with its proof, on page N31. 


To revise the proof that K(s) is a subspace of U we could use Theorem 1.5. 
Instead we present the construction of this proof as a programmed exercise. 


Exercises 


l. Supply the missing Symbols or groups of symbols in the following 
argument. 


LM 2.1.5/2.1.6 


By definition, К(о) is the set 


cea Убу] © 


To show that K(o) isa subspace we must show that, for all a, b e F and 
all a, Ве К(е), we have 


ak + bb |ек(о). (i) 


This is equivalent to showing that 


S = ERY |=0. (i) 


But since c is a linear transformation, we have 


olaa +58) =| ALY + 
bE (iv) 


=0+0 since a, Be K(c) 
=0 


and the proof is complete. 


Look back over your completed proof before you check it against the 
solution. 


2. Exercise 3 on page N35. Do you notice anything about the dimensions 
of Im(c) and К(о)? 
3. Exercise 4 on page N35. (c is a mapping of R* (о R?.) 


Solutions 


1. 
2. 


(i) a(x) (1) ах + bf (iii) ofaa + bB) (iv) ао(«) + bo(f)). 


Im(o) is the subset of R” defined by {(x,,..., x,,0,...,0): 
Xp os Ху ЄК}. This subset is isomorphic to R* and so is k- 
dimensional. To describe K(c), we note that we need an 
(Xis ..., x) such that e(x,,..., x) is equal to (Career, rin 
0,...,0) = (0,..., 0). But this can be true if and only if 
=x, =0. 


x= 
There аге no further conditions restricting хд р, ..., Xp. Thus, 
К(о) = {(0,....0, хаха). 


This subset is isomorphic to R"~* and is of dimension п — К. 
The notable fact about the dimensions of 1т(о) and K(a) is 
that their sum is equal to л. This foreshadows Theorem 1.6, 
which we also met in the Foundation Course. 


We expect that you can show that c is a linear transformation 
without help, so we do not give a solution to this part. The 
determination of the kernel of c is equivalent to solving 
simultaneous linear equations, a technique you have met in 
the Foundation Course. This point is important to remember, 
as you will be required to find the kernel for various linear 
transformations and to relate this to solving a set of linear 
equations. Now by the definition of a kernel, we seek a č e R* 
such that 


о(&) = 0; 
ie. if 
Ë = (х1, Хә, Ху, Ха). 


then 


is just 
(x, — 2x2 — ху — 4x,, X + x5 — 2x4 — 3x4) 
- (0, 0) 
or 
3х; —2x,— x,— 4x, —0 
X; x—2x4 — 3x, = 0. 
This is a set of simultaneous linear equations as promised. 
In fact, there are 2 equations in 4 unknowns: thus, there are 
. not enough equations to determine all of x,, ..., x4, but we 
can use them to determine 2 of the unknowns, say x, and x;, 
in terms of the other 2. This gives 
Xi = хз + 2X4, X2 = X34 + X4. 
This says that to be in the kernel of ø, the components of & 
must be restricted as above, so that the kernel is 


K(o) = {(ху + 2x4, X3 + X4, X3, X4) : хз, X4 ER}. 
2.1.7 Rank and Nullity 


To characterize the subspaces Im(c) and K(o) further, we investigate their 
dimensions. We define 


р(о) = the rank of c = dim Im(c) 
v(o) = the nullity of о = dim К(о). 


As a minor point, note the following short paragraph from page N31. 
“For the rest of this book, unless specific comment is made, we assume 
that all vector spaces under consideration are finite dimensional. Let dim 
U =n and dim V = m.” 


The most important result about rank and nullity is Theorem 1.6 : that 
their sum is equal to the dimension of the domain. We saw an example of 
this in an exercise in the preceding section. We shall call Theorem 1.6 the 
dimension theorem, and it is the main result in Section 1 of this chapter of N. 
The dimension theorem was stated in Unit M100 23, Linear Algebra II and 
an optional proof was given in an appendix there. For the proof of the 
dimension theorem you can look back at Unit M100 23, read the proof 
in N, read our proof just below, or use the proof in the television programme. 
Do not be confused by the multiplicity of proofs; they all amount to the 
same thing, namely seeing what is left over in U after you “hive off” К(о). 


Alternative Proof of Dimension Theorem : p(o) + у(а) = п 


К(о) is a subspace of U; that is, it is a vector space in its own right. This 
means that we can find a basis {a,,..., «,} for К(о), v being short for v(a), 
the dimension of K(c). We know from Theorem 3.6 on page N17 that we can 
extend this linearly independent set to give a basis 

{ais -es Ays heats 0, 
for U. We write 

W = (8,4, . .., Onde 


We now have two subspaces, W and K(o), of U. The most interesting thing 
to notice about these two subspaces is that 


W n K(o) = (0). 


We begin by proving this result. Let us assume that ce W n К(о). Then, 


(i) because «e K(c), we can write a as a linear combination of the basis 
vectors of K(o) : 


а= сау + +c, 
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and (ii) because g e W, we can wi 


rite о as a li inati i 
vectors of JV: inear combination of the basis 


9 = Cyt Oye ++ C1 Oy» 


But we know that « can be expressed uniquely in terms of a complete 


basis fos. , Oty} of U, and we seem to have done it in two distinct ways. 
This contradiction can only be resolved if « = 0. 


So, we can now draw the following diagram. 


К(о) w 


Vectors linearly 
dependent on 
125.2] 


Vectors linearly 
dependent on 


{avaran} 


Vectors linearly dependent on 
a combination of vectors from 
{ay,,ayfand гота, л,-:,а,} 


This result, which is of some interest in its own right, is going to prove 
useful in the rest of the proof below. 


К(о) has dimension v(c) : the complementary subspace” W has dimen- 
sion n — v(ø), by its construction, and if we can prove that W has the same 
dimension as Im(c), then we have proved that p(o) = n — v(a), which is the 
dimension theorem. A way to prove that two spaces have the same dimen- 
Sion is to prove that they are isomorphic. To do this we shall show that the 
mapping с, with domain W (not U) and codomain Im(a) (not V) defined by 


g; 1:0 — —9 0(9) (кє W) 


is an isomorphism. (We write c, instead of с because we have changed 
domain and codomain; properly speaking we have a new mapping.) To 
show that c, is an isomorphism we have to do three things : 


(1) show that it is a linear transformation; 
(ii) show that it is one-one; 
(ii) show that it is onto (with codomain Im(o)). 


(i) is obvious; c, is only ø in disguise. 
(ii) To show that c, is one-one, we require to show that if a, «' Wand 
о #a', then 


oy (x) # c, (x). 
Now since т, is linear, 
с1(0) — o,(a’) = o,(a — a’). 
Since W is a vector space, 
а= «ЕИ. 7 
Also, since W and K(a) have only zero in common and « # о, — х Ф K(a); 
18: 
o,(x — х) #0. 
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Thus 
o(a) — o,(a’) £0; 


o,(@) #0,@’). 
So 
су is one-one. 


(ii) Let f eIm(c). We want to show that there is an ae W such that 
o;(a) = B. We do know that there is an хє U such that о(о) = f because 
BeIm(c); let's see if we can prove that we can choose that а so that it 
belongs to W. There are two possibilities : 


(а) f =0, іп which case 0 is a possibility for «, and we know 0 € W. 
(b) £40, then 


а= а + age + Aye hyn, + a, 


= «к + ау 
Then 
с(0) = о(«к) + alaw) 
=0 + o(ty) 
= o(«y) = o, (ay). 


So, if instead оѓо e U we choose ay e W in this way, we find that a, (ay) = f. 
Thus to every fi e Im(o), there corresponds an element ay € W. This com- 
pletes the proof that c, is an isomorphism of W and Іт(о). Also, since 
isomorphic vector spaces over the same field have the same dimension we 
conclude that 


dim W = dim Im(¢) 


n — Y(o) = р(о) 
as required. 


Now READ the first paragraph on page N32 beginning Theorem 1.6 has 
an important..." : Then READ Corollary 1.14 on page N33. You do not 
need to know a proof of this corollary, but it will be used often when we 
manipulate matrices. In symbols, it states that if t is an isomorphism com- 
posable with c, then 


p(ta) = р(от) = р(о). 
Exercise 


In this exercise we use the linear transformation that we considered in 
Exercise 4 of page N 35: we repeat its definition here. 


Let 
a: (ху, X2, X3, X4) > 
(3x, — 2x4 — xy — 4x4, x, + ху — 2x4 — 3x4) 


() Determine p(c) and hence find v(o). 
(ii) Use this information to verify that 


{@, 1, 1, 0), (2, 1, 0, 1} 


is a basis for K(c). 
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Solution 
G) Since Im(c) = А2, ана 


dim 1п(о) = р(о), by definition 
р(о) = 2. 


Hence, by the Dimension Theorem: 


dim V = dim Im(o) + dim K(o), 
dim Rt = р(о) + v(c) 


4=2 + wo) 
so 
v(a) = 2. 


Gi) Since K(c) has dimension 2, any two linearly independent 
vectors in К(о) form a basis for K(a). 


The given set 
(Q0, 1, 1, 0), (2, 1,0, 1} 


has two members (both in K(o)), and is linearly indepen- 


dent, since 
a(l, 1, 1, 0) + b(2, 1, 0, 1) = (0, 0, 0, 0) 
implies a = b = 0. 


So the given set is a basis for K(c). 
2.1.8 Specifying Linear Transformations 


So far we have specified our linear transformations by specifying their 
effect on every vector in their domains. It is sufficient, however, to specify 
their effect only on a basis in the domain. The next theorem explains why. 


READ Theorem 1.17 on page N34 and its proof. 


This theorem will be used in Unit 3, Hermite Normal Form, where we shall 
find it useful, given an arbitrary set of n vectors in a space V, to think of 
them as the images of the basis vectors in the domain U of a linear trans- 
formation c. The linear transformation obtained depends on what domain 
U is chosen (any n-dimensional vector space will do) and what basis is 
chosen in U. We include the proof as an exercise. 


Exercise 


Fill in the missing words or symbols in the following proof of Theorem 1.17. 


Let (a4, ..., о„} be a basis for U. Then any vector a eU can be expressed 
uniquely in the form 
a= | @ 
where a,,..., a, are scalars, called the 
| Gi) 
of æ with respect to the basis (a, 05, ..., &,)- 


We define the mapping 


8:0 ——9 abi 7 + aff (кєй) 


where fj; e V, i= 1, 2, ..., n. 
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Since the representation (i) is unique, c is a 
| (iii) 


and it has the required property o(«;) = fl; (i = 1, 2,..., п), but we do not 
yet know whether it is a linear transformation, or whether this linear 
transformation is unique. To prove the linearity, let c, c'e F and a, œ’ EU. 


Then, if 


0 = 4,0%,+°''+ ag, 
and 
a = ао + H а, 
we have the unique representation (as in (i)) 
ca + c'a’ = (ca, + c'aia, -- + (ca, + с'а!)о, 


so that 


о(с® + с'а’) = 


(iv) 


(у) 


which proves that о is a linear transformation. To prove that ø is the only 
linear transformation with the required property, we show that any linear 
transformation т with this property 


tla) = В; (2=1,...,п) 
is in fact c. We know already that 


o(a,) = (21,...,n) (vi) 


It follows that 


e-99-| ^  ] 6-1... о 


and, since every element of U is a linear combination of (e, ..., о}, that 


с — tis the 
© өш) 


transformation. Thus we have shown that т = g; ie. с is the only linear 
transformation with the required property. 


Solution 


Ò аа ag, 
(i) coordinates 
(ii) function 
(v) (са,  c'a)B, + +++ (ca, + c'a;)B, 
(v) cola) + c'o(a^). 
(v) f, 
(vii) 0 
(viii) zero 
Finally READ from the end of Theorem 1.17 on page N34 to the end of the 
first paragraph at the top of page N35. 


We use the corollary in place of Theorem 1.17 when faced with less than n 
vectors in V. 
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2.1.9 Summary of Section 2.1 


In this section we defined the terms 


linear transformation 

image of a linear transformation 
inverse image 

complete inverse image 
homomorphism 

one-one 

onto 

isomorphism 

rank of a linear transformation 
kernel of a linear transformation 
nullity of a linear transformation 


We introduced the notation 


(page N27) 
(page N27) 
(page N27) 
(page N27) 
(page N27) 
(page N27) 
(page N28) 
(page N28) 
(page N31) 
(page N31) 
(page N31) 


lm(c): the image of a linear transformation, с 
p(o): the rank of a linear transformation, с 
К(с): the kernel of a linear transformation, с 
*(c): the nullity of a linear transformation, с 


Theorems 


(1.1, page N28) 
The inverse a^! of an isomorphism is also an isomorphism. 


1. 


(page N28) 
(page N31) 
(page N31) 
(page N31) 


2. (page N29) 
If Vis a vector space over F and dim V = n, then V is isomorphic to F”. 
3. (1.2, page N31) 
Im(c) is a subspace of V (the codomain of о). 
4. (page N31) 
Ко) is a subspace of U (the domain of o). 
5. (1.6, page N31) 
p(o) + у(о) = п (the dimension of the domain of c). 
6. (1.14, page N33) 
p(o) = plat) = p(t20) if t,, т, are isomorphisms. 
7. (1.17, page N34) 
Let A = {a,,..., &,) be any basis of U. 
Let B = (f,,..., Ba} be any n vectors in V (not necessarily linearly 
independent) There exists a uniquely determined transformation c 
of U into V such that с(а) = fj; for i— 1,2, ...,n. 
"Techniques 
1. Decide whether a given mapping is a linear transformation. 
Decide whether a given linear transformation c is 
(а) one-one 
(b) onto 
(с) an isomorphism. 
3. Given an isomorphism о, determine с^! 
4. Find с + 62, 0,05, 050, (if they exist), given a, and оз. 
5. Given c and a basis for its domain, determine К(о). 
6. Find p(o), v(c), Im(c) for a given c. 
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2.2 MATRICES 


2.2.1 Isomorphisms Between Linear Transformations and 
Matrices 


Section 2 should be rather easy going for you, as there is only one new idea. 
This is the fact that there is an isomorphism between linear transformations 
and matrices. Putting the horse before the cart, so to speak, we shall say 
that the matrix faithfully represents the linear transformation. Every 
theorem that is true for linear transformations is true for the representing 
matrices, and vice versa! Just as with vectors this numerical representation 
is essential for most computations involving linear transformations, and, 
just as with vectors, the actual numbers appearing in the representation 
depend on the choice of basis. ‘ 


READ from the beginning of Section 2 on page N37 to Equation (2.4) on page 
N39. 


Notes 
(i) Equation (2.2), page N38 This equation is one of the most important equations 
that we shall meet in this course. Let us examine it. Suppose [а] = [5 4}; then 
Equation 2.2 tells us that 

(01) = aufi + anii = Bi + 3B; 

o(a) = 4128: + а: = 28, + 482. 
In words : each column of the matrix (ais) gives the coordinates of the image of one of 
the domain basis vectors. Here the first column of [ау] is () and o(a,) = 18, + 


38; ; the second column of [aij] is @ and o(a2) = 2B; + 4B. 


We often use this to advantage. For if we are explicitly given the images of a 
basis of U as linear combinations of basis vectors of V, we just arrange the co- 
efficients of each equation in columns to construct the representing matrix. 

(ii) Line 2 after Equation (2.2) on page N38 Be sure not to confuse the type-faces. 
The sans-serif A, representing a basis in U, has nothing to do with the italic A, 
representing the matrix. 

(iii) line 3, page N39 The rotations mentioned are illustrated below. The fact that 
rotations about the origin are linear transformations greatly simplifies the cal- 
culation of the formulas for rotations: we have only to compute the effect of the 
rotation on a basis and the whole transformation is determined (because of 
Theorem 1.17 on page N34). 


Example 


90? rotation anticlockwise about the origin 


y 


(0,1) 


(71,0) a N (1,0) 


+> 
x 


(1, 0) —— (0, 1) coordinates of 
(0, 1) — (-1,0) images of basis 


Putting the two coordinates (0, 1) and (— 1, 0) into the first and second 


columns, we get the matrix n E given in N. 
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Example 


General rotation of 0 about the origin 


| 


^" (cos6,sin0) 
Md o o o 
(1,0) 


(1, 0) ———» (cos 0, sin 0) 
(0, 1) —— (sin 0, cos 0) 
The first column of the matrix is therefore 


cos б А —sin 0 
ie At the second is [ cos 0). 


and the complete matrix is given by (2.4) of N. If you like geometric 
illustrations of this type, you may like to try Exercises 7 and 8 of page N43. 


Exercises 


1. Exercise 4, page N42. 
2. Exercise 5, page N43. 
3. Exercise 6, page N43. 


Solutions 
1. Let a, = (1, 0) and a = (0, 1) denote the given basis. 
Then we have o(a,) = (3, — 1) = 3a, — &; 
0(u;) = (—1, 2) = —a, + 2a, 


Filling up the columns of the matrix as explained in note (i) 
to the previous reading passage, we obtain the matrix 


[3 3] 
-1 2) 
2. With x, = (1, 0) and g, = (0, 1) we have, using N's hint, 
o((1, 0) = 00001,1) + 30, 7D) 
= fo((1, 1)) + $o((1, — 0) 
= 4(2, —3) +44, -7) 
= (3, —5) = 3a, — Sa. 
Similarly 
o((0, 1) = оза, 10) – 20, 7D) 
= 30, -3)- 44, -7) 
=(-1,2)=-% + 202. 
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Filling in the columns as before, we get the matrix 


ER 
—5 2|` 
3. We use (1, 0) = a(3, —1) + b(— 1, 2) to find a, b. This gives 
(1,0) = 2G, - D + 4(-1, 2). 
Similarly, ме. find 
(0, 1) = $3, —1) +36 1, 2). 


Then 07 !((1,0)) = 207!((3, —1)) + 407 :0(—1, 2)) and this 
gives the image of a basis element іп terms of basis elements, 
so the first column of the matrix representing ot is 


Also 
c^ (0, 1)) = 107 (G, —1)) + 307 (C7 1, 2)), 


which gives the second column of the matrix; and so the 
complete matrix is 


2$ 1 
[i H ў 
2.2.2 Matrix Algebra 


Since matrices represent linear transformations, the operations of scalar 
multiplication, addition, and multiplication which we can perform with 
linear transformations have their counterparts for matrices. These are 
described in the next reading passage, which is essentially a generalization 
of material already treated in Unit M100 23. 


READ from the line following Equation (2.4) on page N39 to page N41, 
line 1. 
Exercises 


l. Exercise 1, page N42. 
2. Exercise 2, page N42. 
3. Exercise 3, page N42. 


Solutions 


The answers are given on pages N326-327. Note in Exercise 2 that 
the result could have been obtained by using the products in 
Exercise 1. Write products of 1(a), (b) and (c) as 


AB-C (a) 

BD=E (6) 

AE=F (c) 
From (5) 

ABD = AE 


But from (a) AB=C 
and from (c) AE = F 
hence CD =F. 


This is the result you should have calculated. Note the use of 
property 5 on page N40, in the form 


A(BD) — (AB)D. 
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Note in- Exercise 3 that AB 5 BA: in general, matrix multipli- 
cation is not commutative. This corresponds to the fact that, in 


general, the product of linear transformations is not commutative 


(see page N30). Also ignore N's comment about the rank of AB 
and BA (we haven’t defined the rank of a matrix yet). 


2.2.3 Rank and Nullity: Simultaneous Equations 


The last reading passage in this section deals with two topics; first, how we 
define rank for matrices, and second, how we use matrices to write systems 
of simultaneous linear equations in a concise form. 


READ from line 2 of page N41 to the end of the section, line 7, page N42. 
Notes 


(i) Theorem 2.1 The first statement in this theorem is the statement of the dimen- 
sion theorem in terms of matrices. The second statement is the statement of 
Theorem 1.12 on page N33 expressed in matrix form. We omitted Theorem 1.12, 
but you should note the result here in terms of matrices. 

(ii) line 17, page N41 A maximal linearly independent subset of (o(&), ..., о(о,)} 
is a linearly independent subset which is not contained in a larger linearly in- 
dependent subset. Thus in the subset of А2 


(0, 0), (0, 1), (1, — D, ($, 0), 


{(1, 0), (0, 1), ((1, 0), (1, —1)}, etc, are maximal linearly independent subsets. 
(This term is defined on page N14, Exercise 3.) 

(iii) Equation (2.8), page N41 Notice that the surn is now over the second sub- 
script, which labels the columns of the matrix, not the first, which labels the rows, 
as in Equation (2.2). Whenever we multiply two matrices together, the subscripts 
to be summed over are contiguous and equal (as for the subscript “ i" in the law 
of matrix multiplication, 


Cy = Dubra). 


In Equation (2.2) on page N38, on the other hand, we were not multiplying two 
matrices together: the Bs are a set of vectors, not elements of a matrix. 

(iv) line —4, page N41 “ Matric" is an adjectival form of the word “ matrix". 
(v) line 2, page N42 We now have four different ways of representing a vector £ 
belonging to an n-dimensional space U: 


(а) the n-tuple (xi, ..., Xa) € F^ 


(b) the one-column matrix 


(c) the one-row matrix [xi x» +++ Xa] й . - 
(d) the symbol (x;,..., x4) used for typographical convenience as abbreviation 
for the column matrix shown in (b). 


Use whichever of the four representations you like—they are all connected by 
isomorphisms—but do not confuse (a) and (d). 
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2.2.4 Summary of Section 2.2 


In this section we defined the terms 


matrix (page N37) 

order of a matrix (page N37) 

row, column of a matrix (page N37) 

matrix representing a linear transformation (page N38) 

rank and nullity of a matrix (page N41) 
Theorem 


(2.1, page N41) 
For an т x n matrix A, the rank of A plus the nullity of A is equal to п. The 
rank of a product BA is less than or equal to the rank of either factor. 


Techniques 


1. Determine the matrix representing a linear transformation with respect 
to given bases of the domain and of the codomain (Equation (2.2), 


page N38). 

2. Add matrices (Equation (2.5), page N39) 
Multiply a matrix by a scalar (Equation (2.6), page N39) 
Multiply matrices (Equation (2.7), page N40) 


3. Represent vectors and n-tuples (vectors in F") by both row and column 
matrices (pages N41 and 42). 
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2.3 NON-SINGULAR MATRICES 
2.31 Non-singular Matrices 


Thi DE ВЕРИТ 
ТА short Section introduces a classification among square matrices 
epresenting linear transformations U ——> U. The classification is 


based on this question: given a square matrix A, does there exist a matrix B 
such that AB = J, where Г is the square matrix 


u 0 
0 E 


with the same number of rows and columns as A? The matrix J represents 
the identity transformation U ——> U. If B does exist, A is said to be 
non-singular or invertible and we write В = A`}. It also follows that 
АЗА =]. 

Otherwise, A is said to be singular. 


For example, the 2 x 2 matrices R(0) = fes в. ah defined in the 


previous section to represent rotations about the origin, are all non-sing- 
ular, because 


R(O)R(—0) = RO — 0) = RO) = [0 1 


On the other hand, the matrix F el is singular because the matrix 


equation 


[Fal 1-0 1 


has no solution (work out the product on the left if you can't see why). 


READ the whole of Section 3, pages N45-N48. (You have read the last 
paragraph already.) 


Notes 


(i) Line 7, page N46 The symbol ô; is the so-called Kronecker Delta, which we 
first met on page N15. 

(ii) Theorem 3.1 This isa statement of Theorem 1.1 (page N28) forautomorphisms. 
(iii) Theorem 3.2 Ignore the words “ that is, if and only if it is an epimorphism”. 
(iv), Theorem 3.3 Ignore the words “ that is, if and only if it is a monomorphism”. 


These two theorems are a restatement of Theorem 1.8. (page N32), which we 
omitted previously. Both theorems can be derived directly from the dimension 
theorem: we illustrate this by proving Theorem 3.2. (The proofs are not import- 
ant, but you should read the one given: this sort of proof occurs frequently in 
linear algebra.) We have to prove two things (notice the “if and only if" !) 


(a) ifr іѕап automorphism, then it is of rank и; 
(b) if vis of rank x, then it is an automorphism. 
Proof 
(a) т is an automorphism, so it is one-to-one and onto. Since it is onto, Im(7) 
= V, so that р(т) =n. . А . | 
(b) 7 is of rank n, i.e. р(т) = n. This means that Im(7) is of dimension z and т is 
therefore "onto". To show that it is also one-to-one we use the dimension 
theorem. This tells us that the kernel of 7 has dimension 0, since p(r) = dim Im(7) 
=n, and hence that 

(x) =70) 
implies 

x=y, 
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since 

r(x — у) = 0 implies x — y = 0. 
(iv) line —10 to —9, page N46 The statement “automorphisms are the only 
linear transformations which have inverses” is not correct: every isomorphism 
has an inverse. What N means is “automorphisms are the only endomorphisms 
(linear transformations of a set to itself) which have inverses ". 
(v) line 2 et seq., page N47 The deduction in line 2 is an application of the 
second part of Theorem 2.1. You should understand the proofs given. These 
theorems are often used in manipulating matrices. 


Notice particularly that in taking the inverse of a matrix product, the order of the 
factors must be reversed: 
(AB)! = B4" 


(vi) Theorem 3.6 This theorem is a little easier to understand if put this way: 
Let A be non-singular. Then AY = B has solution Y = A~'B and ХА = B has 
solution X = BA^'. These solutions are unique. It is not generally true that 
A" В=ВА”!. 

(vii) Theorem 3.7 This theorem is a direct consequence of Corollary 1.14 (page 
N33), and you should know the result and be able to recognize its implicit usc 
later on in the course. No proof is necessary. 


Exercises 


1, Exercise 1, page N48. 

2. Exercise 2, page N48. (“ Еіпа the square" means multiply the matrix 

by itself.) 

Exercise 3, page N48. 

4. Exercise 5, page N49. (In this question, arc cos # means “ the angle in 
the first quadrant whose cosine is 3. The sine of this angle is +. 


» 


5 4 
3 
arc соз 
3 
5. Exercise 10, page N49. 
Solutions 
1. Show that A714 = I or that 44^! = I. 
2. 900 
A?=110 9 0| =Z. Thus 4"! = 4. 
009 
Note that A? = J does not imply A = I. 
3. 12 3 1 1-4+3 0 
2 3 4||-2| =|2-6+4| = |01. 
012 1 -24+2 0 
If there were an A^!, we would have 
A “AX = A70 
=0. 
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LM 2.3.1 


But 


A AX-X 
so 
X-0 
But 
X#0 


so 471 does not exist. 


1 0 
Alternatively, since Е —» pi the kernel of the 
1 0 
transformation has positive dimension, so that the transfor- 
mation is not one-to-one and therefore not invertible. 
The given matrix is of the form R(0) = 998 9. ane . The 
| sin@ соѕб 
inverse rotation is obtained by rotating back through б, i.e. 
through — 6, so that the inverse matrix is 


Pa peri -| cos 6 Ber 


sin(—0) соѕ(—0)| |-sinO0 cos 


The product k E 3 H -h | 


A sufficient clue to all but the last part of this exercise is given 
in the answer on page N328. For the last part, suppose that 
n> т, then the rank of BA cannot exceed m (Theorem 2.1), 
and so is less than n. So BA cannot be the n x n identity 
matrix which is of rank n. 


2.3.2 Summary of Section 2.3 


In this section we defined the terms 


endomorphism (page N45) 

non-singular or invertible matrix (page N46) 

singular matrix (page N46) 

automorphism (page N46) 
Theorems 


1. (3.6, page N47) 
If A is non-singular, we can solve uniquely the equations XA = B and 
AY — Bfor any matrix B of the proper size, but the two solutions need 
not be equal. 

2. (3.7, page N48) 
The rank of a (not necessarily square) matrix is not changed by multi- 
plication by a non-singular matrix. 


Techniques 


Use the following results when manipulating matrices: 


Q 414 =AA =I 
(ii) (a4)! =a At, aeF 
(ш) (4B) = BA”? 
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2.4 SUMMARY OF THE UNIT 


Definitions 


The terms defined in this unit and page references to their definitions are 
given below. 


linear transformation (page N27) 
image of a linear transformation (page N27) 
inverse image (page N27) 
complete inverse image (page N27) 
homomorphism (page N27) 
one-one (page N27) 
onto (page N28) 
isomorphism (page N28) 
rank of a linear transformation (page N31) 
kernel of a linear transformation (page N31) 
nullity of a linear transformation (page N31) 
matrix (page N37) 
order of a matrix (page N37) 
row, column of a matrix (page N37) 
matrix representing a linear transformation (page N38) 
rank of a matrix (page N41) 
nullity of a matrix (page N41) 
endomorphism (page N45) 
non-singular or invertible matrix (page N46) 
singular matrix (page N46) 
automorphism (page N46) 
Theorems 


We list the important theorems discussed in this unit. Only 2- and 3-star 
theorems which are essential to this and later units have been included in 
this list. References to the statement of the theorems in N are also given. 


1. 


2. 


3. 


10. 
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(1.1, page N28) 

The inverse a^! of an isomorphism is also an isomorphism. 

(page N29) 

If Vis a vector space over F and dim V = n, then V is isomorphic to F”. 
(1.2, page N31) 

Im(a) is a subspace of V (the codomain of о). 

(page N31) 

K(c) is a subspace of U (the domain of c). 

(1.6, page N31) 

р(с) + (9) = п (the dimension of the domain of c). 

(1.14, page N33) 

p(a) = p(ot,) = p(150) if 1,, т, are isomorphisms. 

(1.17, page N34) 

Let A = {a,,..., а,} be any basis of U. 

Let B = (f,,..., Ba} be any n vectors in V (not necessarily linearly 
independent). There exists a uniquely determined transformation с of 
U into V such that o(a;) = f; for i = 1, 2,..., п. 

(2.1, page N41) 

Foranm x n matrix A, the rank of A plus the nullity of A is equal to n. 
The rank of a product BA is less than or equal to the rank of either 
factor. 

(3.6, page N47) 

If A is non-singular, we can solve uniquely the equations ХА = B and 
AY = Bfor any matrix B of the proper size, but the two solutions need 
not be equal. 

(3.7, page N48) 

The rank of a (not necessarily square) matrix is not changed by 
multiplication by a non-singular matrix. 


Techniques 


1. Decide whether a given c is a linear transformation. 
2. Decide whether a given linear transformation is 
(a) one-one 
(b) onto 
(c) an isomorphism. 
3. Given an isomorphism ø, determine o`t. 
4. Find o; + 2, 0,03, 020, (if they exist), given c, and оз. 
5. Given c and a basis for its domain, determine К(о). 
6. Find р(о), v(c), Im(o) for a given c. 
7. Determine the matrix representing a linear transformation with res- 
pectto given bases of the domain and of the codomain (Equation (2.2), 
page N38). 
8. Add matrices (Equation (2.5), page N39) 
Multiply a matrix by a scalar (Equation (2.6), page N39) 
Multiply matrices (Equation (2.7), page N40) 
9. Represent vectors and n-tuples (vectors іп F") by both row and column 
matrices (pages N41 and 42). 
10. Use the following results when manipulating matrices: 
(i) 474 = 4471 =] 

Gi) (04): =а-!А7!, aeF 

(iti) (48): = В-:4-!. 
Notation 
Im(o): the image of a linear transformation, т (page N28) 
р(с) : the rank of a linear transformation, с (page N31) 
K(o) : the kernel of a linear transformation, с (page N31) 
у(а) : the nullity of a linear transformation, т (page N31) 
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2.5 SELF-ASSESSMENT 


Self-assessment Test 


This Self-assessment Test is designed to help you test quickly your under- 
standing of the unit. It can also be used, together with the summary of the 
unit, for revision. The answers to these questions will be found on the next 
non-facing page. We suggest you complete the whole test before looking at 
the answers. 


1. 


8. 


Let c be any linear transformation, с: U ——> V. Let (e... 
be a basis of О, and let а 22a, — а + &,. Express o(«) as a linear 
combination of о(о;), o(@2),..., o(«,). 


Complete the following statement. Let с be a transformation of U into 
V. In order to prove that a is a /inear transformation, we take arbitrary 
a, PeU, arbitrary a, be F and show that p мй эл == 
Let o : R? ——> R? be о: (ху, х) > (ху +х,, X3). Is са linear 
transformation? 
Which of the following mappings are isomorphisms? 
(а) U= R, И = R330: (x, x2, x) — (x3, x2, ху) 
(b U-Ry-Ruo: (х, х2, x3) — 9 (x, x;, х) 
() О= К, у= Ру; о: (ху, x; X3) —> ху + xat + ху? 
(d О= №, у= К; о: (ху, x2) ——9 (0, ху, x2). 
Let с: R? ———> R? be 

6: (X15 X2, X3) —— (у — X2, X2 — X3, X4 — Xi). 
(i) What is the kernel of a? 
(ii) What is the rank of o? 


Derive the matrix representing the automorphism of R? defined by: 
(ху, х2, x3) — (ху, =, x2) 


with respect to the basis {(1, 0, 0), (0, 1, 0), (0, 0, 1)}, for both domain 
and codomain. 


a b 2 0 
ма 2-р 


Determine AD — DA. 
If A, B are non-singular л x n matrices, which of the following is equal 
to (B^ 14)7!? 


(a) BA (b 4-18 (с) BULA 
(d) 47187! (е) ВАС! (Е) ABT. 
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Solutions to Self-assessment Test 


1. o(a) = o(20, — &; + &) 
Since c is a linear transformation, 
o(a) = o(2a,) + o(—a2) + о(о,) 
= 20(01) — o(;) + с(о,). 
2. +++ o(ax + bp) = ao(a) + bolh) 
(An equivalent method is to show that 
o(ax) = ас(о) 
and 
aola + В) = ala) + o(f).) 
3. Yes. 
alali, хз) + (у, уз) 
= o((ax, + бу, ax, + by2)) 
= (ax, + by, + ax; + Бу, ах; + Бу) 
= (a(x, + x3) + БО + р), ах› + Буз) 
= a(x, + X2, x3) + 605 + Y2, у») 
= ас(х\, хз) + boys. Уз). 
4. (a) and (с) are isomorphisms. 
(b) and (d) are not isomorphisms. For (b), we see that c is not onto 
(for example, (1, 2, 3) ¢ Im(c)) nor is it one-one (for example, 
0((1, 2, 3)) = o((1, 2, 4)) = (1, 2, 2). 
For (d), the mapping is not onto (for example, (1, 2, 3) £Im(o)). с is 
one-one, however. 
S. (i) If (x1, x2, x3) e K(o) 
о((х1, хз, X3)) = (0, 0, 0) 
іе. 
(x, — X2, X2 — X3, X3 — xi) = (0, 0, 0). 
So 
х= х 
X2 = х3 
Хз = Ху 
ie. 


XQ — X4 = X3 
and hence K(a) = {(x;, x3, x3): ху = х) = хз = a, ae К). 
Gi) p(o) = dim Im(o) 
If (xj, х2, хз) eIm(o), 
Xi +x + х3 = 0 
thus Im(c) = {(x), x2, x3) : xy + X2 + x4 = 0} 
= (Qs х2, — Oy + х›))} 
Le. 
dim Im(o) = p(o) =2. 
Alternatively, by the dimension theorem 


n=v+p 
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p=n-y 
-3-1 
=2 
since 
v=dim К(о) = 1. 
o: (xy, X2, x3) ——— (Ху, — X41, X2) 
So 
в((1, 0, 0)) = (0, —1, 0) 
a((0, 1, 0)) = (0, 0, 1) 
a((0, 0, 1)) = (1, 0, 0). 
Using Equation (2.2) on page N38, viz 


(uj) = b auf, 
izi 


e((1, 0, 0)) = —(0, 1, 0) 
= 0(1, 0, 0) ~ 100, 1, 0) + 0(0, 0, 1) 
o((0, 1, 0)) = (0,0, 1) 
=0(1, 0, 0) + 0(0, 1, 0) + 100, 0, 1) 
o((0,0,1))= (1,0, 0) 
= 1(1, 0, 0) + 0(0, 1, 0) + 000, 0, 1). 
Hence the matrix representing the transformation 


Ap =|% 9 2 0] [ах2+0 0+6x1 
zi dji0 1] |[ex2+0 о+ахт 


DA = 2 0|[а b] [2ха+о 2xb+0 
n ~(O+1xce O+1xd 


Е - 
Hence AD — DA = 0 | 


Since (48)! = B^!4^! 
(B^!A4)! =A (B™)7! 
= uw 


Hence (b) is the correct answer. 


335 01090 3 
335 01091 1 


